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CHAPTER 1 


DIFFERENTIAL EQUATIONS 


1.1 STATEMENT OF THE PROBLEM. THE EQUATION 
OF MOTION OF A BODY WITH RESISTANCE 
OF THE MEDIUM PROPORTIONAL TO THE VELOCITY. 
THE EQUATION OF A CATENARY 


Let a function y=f(x) reflect the quantitative aspect of some 
phenomenon. Frequently, it is not possible to establish directly 
the type of dependence of y on x; but it is possible to give the 
relation between the quantities x and y and the derivatives of y 
with respect to x: y’, y", ..., y™. That is, we are able to 
write a differential equation. 

From the relationship established between the variables x, y 
and the derivatives it is required to determine the direct depen- 
dence of y on x; that is, to find y=f(x) or, as we say, to inte- 
grate the differential equation. 

Let us consider two examples. 

Example 1. A body of mass m is dropped from some height. It is required 
to establish the law according to which the velocity v will vary as the body 
falls, if, in addition to the force of gravity, the body is acted upon by the 
decelerating force of the air, which is proportional to the velocity (with con- 
stant of proportionality k); in other words, it is required to find v= f (t). 

Solution. By Newton’s second law 


where 5 is the acceleration of a moving body (the derivative of the velocity 


with respect to time) and F is the force acting on the body in the direction 
of motion. This force is the resultant of two forces: the force of gravity mg 
and the force of air resistance, — kv, which has the minus sign because it is in 
the opposite direction to that of the velocity. And so we have 


du 

mgp "Eko (1) 
This relation connects the unknown function v and its derivative $; we have 
a differential equation in the unknown function v. This is the equation of mo- 
tion of certain types of parachutes. To solve a differential equation means to 
find a function v= f(t) such that identically satisfies the given differential 
equation. There is an infinitude of such functions. The student can easily verify 
that any function of the form 


R 
v=Ce m4 8 © 
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satisfies equation (1) no matter what the constant C is. Which one of these 
functions yields the sought-for dependence of v on t? To find it we take advantage 
of a supplementary condition: when the body was dropped it was imparted an 
initial velocity vọ (which miy be zero as a particular case); we assume this 
initial velocity to be known. But then the unknown function v= f (t) must be 
such that when ¢=0 (when motion begins) the condition v=vọ is fulfilled. 
Substituting ¢=0, v= v into formula (2), we find 


whence A 
aa 3 
Thus, the constant C is found, and the sought-for dependence of v on £ is 
kt 
vm (Em +E e 


From this formula it follows that for sufficiently large ¢ the velocity v de- 
pends but slightly on vo. 

It will be noted that if k=O (the air resistance is absent or so small that 
we can disregard it), then we have a result familiar from physics: * 


v=v)+et (2°) 


This function satisfies the differential equation (1) and the initial condition: 
v=v, when ¢=0. 

Example 2. A flexible homogeneous thread is suspended at two ends. Find 
the equation of the curve that it describes under its own weight (it is the same 
as for any suspended ropes, wires, chains). 

Solution. Let Me (0, b) be the lowest point 
of the thread, and M an arbitrary point 
(Fig. 1). Let us consider a part of the thread 
M,M. This part is in equilibrium under the 
action of the resultant of three forces: 

(1) the tension T, acting along the tangent 
at the point M and forming an angle ọ with 
the x-axis; 

(2) the tension H at Mọ acting horizontally; 

(3) the weight of the thread ys acting ver- 
tically downwards, where s is the length of the 
arc MyM and y is the linear specific weight of 
the thread. 

Breaking up the tension T into horizontal 
k and vertical components, we get the equations 
Fig. 1 of equilibrium: 


T cos ọ =H, T sin p= ys 


Dividing the terms of the second equation by the corresponding terms of 
the first, we obtain 


tang= 7s (3) 
* Formula (2”) can be obtained from (2’) by passing to the limit: 


lim [ (%»—“£ ) om 4 aE] =u + gt 


k-0 
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Now suppose that the equation of the sought-for curve can be written in 
the form y=f(x). Here, f(x) is an unknown function that has to be found. 
It will be noted that 


; d 
tan p=F" =F 
Hence, 

1 


where the ratio Zz is denoted by a. 
Differentiate both sides of (4) with respect to x: 


d?y _ 1 ds 
dea de 6) 


But, as we know (see Sec. 6.1, Vol. I), 


Substituting this expression into equation (5), we get the differential equa- 
tion of the sought-for curve: 


It expresses the relationship between the first and second derivatives of the 
unknown function y. 

Without going into the methods of solving the equations, we note that any 
function of the form 


y=acosh( Ž +61) +6, o 


satisfies equation (6) for any values that C, and C, may assume. This is evident 
if we put the first and second derivatives of the given function into (6). We 
shall later on indicate (Sec. 1.18), without proof, that these functions (for 
different C, and C,) exhaust all possible solutions of equation (6). 

The graphs of all the functions thus obtained are called catenaries. 

Let us now find out how one should choose the constants C, and C, so as 
to obtain precisely that catenary whose lowest point M has coordinates (0, b). 
Since for x=0 the point of the catenary occupies the lowest possible position, 


the tangent here is horizontal, Wo. Also, it is given that at this point the 


ordinate is equal to b y=b. 
From (7) we find 


y'=sinh (+c) 
a 
Putting x=0 here, we obtain O=sinhC,. Hence, C,=0. If the ordinate of 
the point Mọ is b, then y=b when x=0. 
From equation (7) we get b=F (I+ 1)+Cs, assuming x=0 and C,=0, 
whence C,=6—a. Finally we have 


y =a cosh (=)+0-a 


14 Ch. 1 Differential Equations 
Equation (7) assumes a very simple form if we take the ordinate of My equal 
to a. Then the equation of the catenary is 

y =a cosh (x/a) 


1.2 DEFINITIONS 


Definition 1. A differential equation is one which connects the 
independent variable x, unknown function y= f(x), and its deri- 
vatives y’, Y", ..., y™. , 

Symbolically, a differential equation may be written as follows: 


F(x, Y, y's Y”, wees Y™)=0 


F(x i a re Ft) =0 


or 


If the sought-for function y= f(x) is a function of one indepen- 
dent variable, then the differential equation is called ordinary. 
In this chapter we shall deal only with ordinary differential 
equations. * 

Definition 2. The order of a differential equation is the order 
of the highest derivative which appears. 

For example, the equation 


y’ —2xy?+5=0 


is an equation of the first order. 
The equation 
y” + ky’ —by—sinx=0 


is an equation of the second order, etc. 

The equation considered in the preceding section in Example 1 
is an equation of the first order, in Example 2, one of the second 
order. 

Definition 3. The solution or integral of a differential equation 
is any function y= f(x), which, when put into the equation, 
converts it into an identity. 


* In addition to ordinary differential equations, mathematical analysis also 
deals with partial differential equations. Such an equation is a relation between 
an unknown function z that is dependent upon two or several variables x, y,..., 

A : Pere oz oz oz 
these variables x, y, ..., and the partial derivatives of z: an’ oy? On” etc. 

The following is an example of a partial differential equation in the unknown 

function z (x, y): 4 P 
z z 


Er oy 
It is easy to verify that this equation is satisfied by the function z =x?y? 


(and also by a multitude of other functions). 
In this course partial differential equations are discussed in Chapter 6. 
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Example 1. Suppose we have the equation 
d? 
Jatu=0 


The functions y=sinx, y=2 cosx, y=3sinx—cosx and, in general, 
functions of the form y =C; sin x, y =C; cos x or 


y =C, sin x+ C, cos x 


are solutions of the given equation for any choice of constants C, and C,; this 
is evident if we put these functions into the equation. 
Example 2. Let us consider the equation 


y'x—x?—y=0 

Its solutions are all functions of the form 
y=x4+-Cx 
where C is any constant. Indeed, differentiating the functions y=x*+Cx, we 
find 
y' = 2x+C 
Putting the expressions for y and y’ into the initial equation, we get the 
identity 
(2x -+C) x —x?— x®—Cx=0 

Each of the equations considered in Examples 1 and 2 has an infinitude of 
solutions. 


1.3 FIRST-ORDER DIFFERENTIAL EQUATIONS 
(GENERAL NOTIONS) 


1. A differential equation of the first order is of the form 


F(x, y, y')=0 (1) 
If this equation can be solved for y’, it can be written in the form 
y =f (x, y) (1’) 


In this case we say that the differential equation is solved for 
the derivative. For such an equation the following theorem, called 
the theorem of existence and uniqueness of solution of a differen- 
tial equation, holds. 

Theorem. /f in the equation 


y' =f (x, y) 
the function f(x, y) and its partial derivative with respect to y, 
ay we continuous in some domain D, in an xy-plane, containing 
some point (Xə, Yo), then there is a unique solution to this equation, 
y= 9 (x) 


which satisfies the condition y= Y, at x= Xp. 
This theorem will be proved in Sec. 4.27. 
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The geometric meaning of the theorem consists in the fact that 
there exists one and only one such function y= ọ (x), the graph 
of which passes through the point (xo, Yo). 

It follows from this theorem that equation (1’) has an infinitude 
of solutions [for example, a solution the graph of which passes 
through (x9, Yo); another solution whose graph passes through 
(xo Yı); through (x, Y), etc., provided these points lie in the 
domain D]. 

The condition that for x=x, the function y must be equal to 
the given number y, is called the initial condition. It is frequently 
written in the form 


Y |xa% = Yo 


Definition 1. The general solution of a first-order differential 
equation is a function 


y= 9 (x, C) (2) 


which depends on a single arbitrary constant C and satisfies the 
following conditions: 

(a) it satisfies the differential equation for any specific value of 
the constant C; 

(b) no matter what the initial condition y=y, for x= x, that 
is, (Y)x=x,=¥Yo, it is possible to find a value C=C, such that the 
function y=@(x, C.) satisfies the given initial condition. It is 
assumed here that the values x, and y, belong to the range of the 
variables x and y in which the conditions of the existence and 
uniqueness theorem are fulfilled. 

2. In searching for the general solution of a differential equation 
we often arrive at a relation like 


M(x, y, C)=0 (2’) 


which is not solved for y. Solving this relationship for y, we get 
the general solution. However, it is not always possible to express 
y from (2’) in terms of elementary functions; in such cases, the 
general solution is left in implicit form. An equation of the form 
©® (x, y, C)=0 which gives an implicit general solution is called 
the complete integral of the differential equation. 

Definition 2. A particular solution is any function y=@(x, Co) 
which is obtained from the general solution y =ọ (x, C), if in the 
latter we assign to the arbitrary constant C a definite value C=C,. 
In this case, the relation ® (x, y, C,)=0 is called a particular 
integral of the equation. 


Example 1. For the first-order equation 
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the general solution is a family of functions y="; this can be checked by 


simple substitution in the equation. 
Let us find a particular solution that will’ satisfy the following initial 
condition: yy=1 when x»=2. 


Putting these values into the formula =£ , we have Int or C=2, 


Consequently, the function y= will be the particular solution we are 
seeking. 


From the geometric viewpoint, the general solution (complete 
integral) is a family of curves in a coordinate plane, which family 
depends on a single arbitrary constant C (or, as it is common to 
say, on a single parameter C). These curves are called integral 
curves of the given differential equation. A particular integral is 
associated with one curve of the family that passes through a 
certain given point of the plane. 

Thus, in the latter example, the complete integral is geometri- 


cally depicted by a family of hyperbolas y=, while the partic- 


ular integral defined by the given initial condition is depicted 
by one of these hyperbolas passing through the point M,(2, 1). 
Fig. 2 shows the curves of a family that are associated with 


certain values of the parameter: C=, C=1, C=2, C=—1,etc. 


To make the reasoning still more pictorial, we shall from now 
on say that not only the function y =ọ (x, C.) that satisfies the 
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equation but also the associated integral curve is a solution of 
the equation. We will therefore speak of a solution passing through 
the point (xə, Yo). 

Note. The equation ay _ —+ has no solution passing through a 


point lying on the y-axis (see Fig. 2). This is because the right 
side of the equation is not defined for x=0 and consequently is 
not continuous. 

To solve (or as we frequently say, to integrate) a differential 
equation means: 

(a) to find its general solution or complete integral (if the initial 
conditions are not specified) or 

(b) to find a particular solution of the equation that will satisfy 
the given initial conditions (if such exist). 

3. Let us now give a geometric interpretation of a first-order 
differential equation. 

Let there be a differential equation solved for the derivative: 


a — F(x, y) (1’) 


and let y=ọ (x, C) be the general solution of this equation. This 
general solution determines the family of integral curves in the 
xy-plane. 

For each point M with coordinates x and y, equation (1’) 


defines the value of the derivative u, or the slope of the tangent 


line to the integral curve passing through this point. Thus, the 
differential equation (1’) yields a collection of directions or, as 
we say, defines a.direction-field in the xy-plane. 

Consequently, from the geometric point of view, the problem 
of integrating a differential equation consists in finding curves, 
the directions of the tangents to which coincide with the direction 
of the field at the corresponding points. 

For the differential equation (1) the locus of points at which 


the relation 4 —C =const holds true is called the isocline of the 


given differential equation. 
` Different isoclines result from different values of C. The equation 
of the isocline corresponding to the value C will clearly be f (x, y)=C. 
If we have constructed a family of isoclines, it is possible to make 
a rough construction of the family of integral curves. We say 
that a knowledge of the isoclines enables one to determine quali- 
tatively the locations of the integral curves in a plane. 

Fig. 3 depicts a direction-field defined by the differential equation 


dy y 


x 
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The isoclines of the given differential equation are 
—£=C, or y=*—Cx 
This is a family of straight lines. They are constrycted in Fig. 3. 


4. Let us now consider the following problem. 


Y 
=-4x $ =4r 
=-2L a 4 | \ 2 


Fig. 3 


Let there be given a family of functions that depends on a 
single parameter C: 


y= 9 (x, C) (2) 


and let only one curve of this family pass through each point of 
the plane (or some region in the plane). 


For what differential equation is this family of functions a com- 
plete integral? 


From relation (2), differentiating with respect to x, we find 
d , 
Wgl, C) (3) 


Since only one curve of the family passes through each point 
of the plane, for every number pair x and y, a unique value of 
C is determined from equation (2). Putting this value of C into 


(3), we find 4 as a function of x and y. This is what yields 


the differential equation that is satisfied by every function of the 
family (2). 


\ 
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Hence, to establish a relationship between x, y and ed that is, 


to write a differential equation whose general solution is given by 
formula (2), one has to eliminate C from relations (2) and (3). 


Example 2. Find the differential 
equation of the family of parabolas 
y =Cx (Fig. 4). 

Differentiating the equation of 
the family with respect to x, we 
get 


dy _ 
T Oe 


Putting the value C =-% into 
x 


this equation from the equation of 
the family, we obtain a differential 
equation of the given family: 
dy Oe. 
ds x 
This differential equation is 


meaningful when x 4 0 which is to 
say, in any region not containing points on the y-axis. 


Fig. 4 


1.4 EQUATIONS WITH SEPARATED AND SEPARABLE VARIABLES. 
THE PROBLEM OF THE DISINTEGRATION OF RADIUM 


Let us consider a differential equation of the form 
d 
T =h (x) fa Y) (1) 


where the right side is a product of a function dependent only 
on x by a function dependent only on y. We transform it in the 
following manner assuming that f, (y) 0: 


pg =h (x) dx (1) 


Considering y a known function of x, equation (1’) may be regard- 
ed as an equality of two differentials, while the indefinite integrals 
of them will differ by a constant term. Integrating the left side 
with respect to y and the right with respect to x, we obtain 


frg =Sh@dx+c (1") 


which is a relationship connecting the solution of y, the indepen- 
dent variable x, and an arbitrary constant C; we have thus obtained 
a general solution (complete integral) of equation (1). 

1. A type (1’) differential equation 


M (x) dx +N (y)dy =0 (2) 
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is called an equation with separated variables. From what has 
been proved, its complete integral is . 


f M(x)dx+ JN y)dy=C 


Example 1. Given an equation with separated variables: 


xdx+ydy=0 
Integrating we get the general solution: 

x? y? 

z ie 


Since the left side of this squanon is nonnegative, the right side is also 
nonnegative. Denoting 2C, by C?, we will have 


x? y2—C? 
This is the equation of a family of concentric 


circles (Fig. 5) with centre at the coordinate 
origin and radius C. 


2. An equation of the form 
M, (x) N, (y) dx + M, (x) N,(y)dy=0 (3) 
is called an equation with separable 


variables. It can be reduced* to an 
equation with separated variables by 


Fig. 5 
dividing both sides by the expression N, (y) M, (x): 
Mı (x) Ny W) gy 4 Ms (x) Na (y) dy =0 


Nx (y) Ma (x) Nı (y) Ma (x) 
or 
Mı (x) Na (Y) 4 
Mat N, (y) dyo 


that is, to an equation like (2). 


Example 2. Given the equation 


dy y 
dx x 
Separating variables, we have 
dy Z 
y x 
Integrating, we find 
d dx 
o 


* These transformations are permissible only in a region where neither N, (y) 
nor Mg (x) vanish. 
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which is 


Injy|=—In]x]+in|C|* or In|y|=In 


ce 
x 
whence we get the general solution: =Â. 


Example 3. Given the equation 
(1+x) y dx+(1— y) x dy =0 
Separating variables we have 
Hari tuo (pjaga 
Integrating, we obtain 
Injx|+x+In|y[—y=C or In|xy|+x—y=C 


This relation is the complete integral of the given equation. 

Example 4. It is known that the decay rate of radium is directly propor- 
tional to its quantity at each given instant. Find the law of variation of a 
mass of radium as a function of the time if at ¢=0 the mass of radium was mgo. 

The decay rate is determined as follows. Let there be mass m at time £, and 


mass m-+-Am at time ¿+ At. During time At mass Am decays. The ratio 4% is 
the mean rate of decay. The limit of this ratio as At — 0 
lim Am am 
At+o A dt 
is the rate of decay of radium at time £. 
It is given that 
qoim (4) 


where k is the constant of proportionality (k > 0). We use the minus sign 
because the mass of radium diminishes as time increases and therefore am <0. 


dt 
Equation (4) is an equation with separable variables. Let us separate the 
variables: - 
cole ag kdt 
m 
Solving the equation we obtain 
Inm=—kt+1nC 
whence 
In r= —kt 
m=Ce-*t (5) 


Since at #=0 the mass of radium was mọ, C must satisfy the relationship 
ty = Ce" =C 
* Having in view subsequent transformations, we denoted the arbitrary 


constant by In|C|, which is permissible since In |C | (when C # 0) can take on 
any value from — œ to +œ. 
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Putting the value of C into (5) we get the desired mass of radium as a function 
of time (Fig. 6): ° 


m= mye-ht (6) 


The constant k is determined from observations as follows. During time fọ let 
a% of the original mass of radium decay. Hence, the following relationship is 


fulfilled: 
a a -kt m 
(1-5) My =m"? 
whence P 
a o 
or i o 
ENEL rAd Fig. 6 
k= i In (1 166) 


Thus, it has been determined that for radium k= 0.000436 (the unit of time 
measurement is one year). 
Putting this value of & into (6) we obtain 


n= te 9:000436t 


Let us find the half-life of radium, which is the interval of time during which 


half of the original mass of radium decays. Putting Te in place of m in the 


latter formula, we get an equation for determining the half-life T: 


m 
z = mye ~ 90004367 


whence 
—0.0004367 = — In2 
or 
In 2 


T = 9000436 


=1590 years 


Some other problems of physics and chemistry can be reduced to equations 
of the form (4). 


Note 1. Let the function f,(y) of (1) have a root y=b, i.e., 
fa(b)=0. Then the function y =b is clearly a solution of equation 
(1); this can be readily verified by direct substitution. The formula 
(1”) may not yield the solution y =b. We will not consider this 
case here, but will note that the uniqueness condition may fail 
to hold on the line y=0. 

By way of example, the equation y =2Vy has the general 
solution y=(x-+c)* and the solution y=0, which does not follow ` 
from the general solution. The uniqueness condition is violated 
on the line y=0. 

Note 2. The simplest differential equation with separated vari- 
ables is one of the form 


=i (x) or dy=f(x)dx 
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Its general solution is of the form 
y= f f (x)dx+C 


We dealt with the solution of equations of this kind in Ch. 10, 
Vol. I. 


1.5 HOMOGENEOUS FIRST-ORDER EQUATIONS 


Definition 1. The function f(x, y) is called a homogeneous 
function of degree n in the variables x and y, if for any A the 
following identity is true: 


f (Ax, Ay) =Aa"f (x, y) 
Example 1. The function f(x, y)= fet y® is a homogeneous function of 
degree one, since 
i (Ax, Ay) = j/ Ox F Oy =A j/ P+ =I (x, y) 


Example 2. f(x, y)=xy— is a homogeneous function of degree two, since 
(Ax) (Ay)— (Ay)? =A? vy 4’). 


2 
Example 3. on a Z} isa homogeneous function of degree zero since 
(Ax)? — (Ay)? 
tata S , that is, f(Ax, Ay)=f(x, y) or f (Ax, Ay) =A°F (x, y). 


Definition 2. “An equation of the first order- 


is called homogeneous in x and y if the function f(x, y) is a ho- 
mogeneous function of degree zero in x and y. 
Solution of a Homogeneous equation. It is given that f (Ax, Ay) = 


= f (x, y). Putting r=} in this identity, we have 
fæ W=F(1 4) 
Thus, a homogeneous function of degree zero is dependent only 


on the ratio of the arguments. 
In this case, equation (1) takes the form 


a=1(1, 4) a’) 


we get 
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Putting this expression of the derivative into equation (1’), we 
obtain ° 


u+x =f (1,4) 


This is an equation with variables separable: 
d di d 
xZ =İ(, u)—u or gai s 
Integrating we find 
du dx 
an 


Putting the ratio 4 in place of ù after integration, we get the 
integral of equation (1’). 
Example 4. Given the equation 
J dy xy 
dy xi— y? 


On the right is a zero-degree homogeneous function, which means that we have 


a homogeneous equation. Making the substitution =u, we have 


= dy _ du 
y=ux, ants 


dx 1—ui» dx 1—u? 


Separating variables, we obtain. 
(1 —u?) du _ dx 1 l _ dx 
“uO ms 
Whence, integrating, we find 


uv u 


1 1 
— 7,7 lnful=in|x|+In] Cc} or ~za mln |u]. 


Substituting u=2 , we get the general solution of the original equation: 
x 
-zam |Cy| 


It is impossible here to get y as an explicit function of x in terms of elemen- 
tary functions. Incidentally, it is very easy to express x in terms of y: 


x=y V —2In|Cy| 
Note. An equation of the type 
M (x, y)dx+N (x, y)dy=0 


will be homogeneous if, and only if, M(x, y) and N (x, y) are 
homogeneous functions of the same degree. This follows from the 
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fact that the ratio of two homogeneous functions of the same de- 
gree is a homogeneous function of degree zero. 
Example 5. The equations 
(2x + 8y) dx + (x —2y) dy =0 
(x2 + y?) dx —2xy dy =0 
are homogeneous. 


1.6 EQUATIONS REDUCIBLE FO HOMOGENEOUS EQUATIONS 


Equations of the following type are reducible to homogeneous 
equations: 
dy _ ax-+by+e (1) 
dx ax by +c 
If c,=c=0, then equation (1) is obviously homogeneous. Now let 
c and c, (or one of them) be different from zero. Make a change 
of variables: 
x=xļ% +h, y=y,t+k 
Then 
dy _ dy, 
dx dx; (2) 
Putting into (2) the expressions for x, y, and u, we obtain 


dx, axıt biyi +h + bik +c 
Choose h and k so that the following equations are fulfilled: 
ah+bk+c=0 
ah+bikte=0 (4) 
In other words, define h and k as solutions of a system of equa- 
tions (4). Equation (3) then becomes homogeneous: 
dy, _ axı +byı 
dx, aX + bys 
Solving this equation and passing once again to x and y by 
formulas (2), we obtain the solution of equation (1). 
The system (4) has no solution if 
a b 
a, b, 


i. e.,ab, = a,b. But in this case“! =" =A, that is, a,=Aa, b, =b, 


and, hence, equation (1) may be transformed to 


dy _ _(ax+by)+e_ (5) 
dx  A(ax+by) +c, 


|=0 
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Then by substitution 
z=ax-+by ° (6) 


the equation is reduced to one with variables separable. 
Indeed, 


dz dy 
—=at+b= 
whence 
dy. ldz a 
Oleg emery (7) 


which is an equation with variables separable. 
The device applied to integrating equation (1) is also applied 
to the integration of the equation 
Yp (Ete) 
dx ax + biy +c 
where f is an arbitrary continuous function. 
Example 1. Given the equation 
dy _x+y—3 
dx x—y—1 
To convert it into a homogeneous equation, make the substitution s=x,+h, 
y =y +k. Then 
dyr _ ity th+k—3 
dxı %y— yi th—k—l 
Solving the set of two equations 
h+k—3=0, h—k—1I=0 
we find 
h=2, k=l 
As a result we get the homogeneous equation 
dy Xiti 
dx, Xi 
which we solve by substitution: 


then 


28 Ch. 1 Differential Equations 


and we get an equation with variables separable 


du __1+u?- 
Vdx, I—u 
Separating the variables, we have 
l—u du= d*y 
I+ u? x1 


Integrating, we find 
arctan u—-5 In (1+) =n |x |+1n|C] 
arctan u=In|C x, V 1+? | 


or 
Cx, Tut = erctan u 
Putting # in place of u, we obtain 
1 
arctan z 
CV åt =e : 
Passing to the variables x and y, we finally get 
EEEE arctan s-i 
c Vu-FF ue #7? 
Example 2. The equation 
Y =i Qy+5 


cannot be solved by the substitution x=x,+h, y=y,-+k, since in this case 
the set of equations that serves to determine A and & is insolvable (here, the 


determinant l : of the coefficients of the variables is equal to zero). 
This equation may be reduced to one with variables separable by the 


substitution 
2x-+-y=2z 
Then y’=z’—2 and the equation is reduced to the form 
z—l 
2= 5 
or 
ae t9 
~ 22-45 


Solving it we find 5 
7 
5 z+ In |52z+9|=x+C 
Since z=2x-+y, we obtain the final solution of the initial equation in the form 


F QOx-+y) +z In| 10x-+5y-+9|=2+C 


or 
10y—5x-+7 In| 10x+-5y+9|=C, 


that is, as an implicit function y of x. 
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1.7 FIRST-ORDER LINEAR EQUATIONS 


Definition. A first-order linear equation is an equation that is 
linear in the unknown function and its derivative. It is of the 
form 


+ P(x) y=Q (x) (1) 


where P (x) and Q(x) are given continuous functions of x (or are 
constants). 

Solution of linear equation (1). Let us seek the solution of 
equation (1) in the form of a product of two functions of x: 


y =u (x) v(x) (2) 


One of these functions may be arbitrary, while the other will 
be determined from equation (1). 
Differentiating both sides of (2), we find 
dy _ du du 
dx 4 Ge Tae 
Putting the expression obtained of the derivative # into (1), we 
have 


ut+Ho+ Puv=Q 


or 
u( E+ Pol +uE=Q (3) 
Let us choose the function v such that 
d 
+ Pu=0 (4) 


Separating the variables in this differential equation with respect 
to the function v, we find 


Integrating we obtain 
—In|C,|+In|o]=—§ Pdx 

or 

-f Pdx 

vu=Cye G 


Since it is sufficient for us to have some nonzero solution of 
equation (4), we take, for the function v (x), 


-f Pax (5) 


where | Pax is some antiderivative. Obviously, v(x) 0. 


v(x)=e 
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Putting the value of v(x) which we have found into (3), we get 
(noting that #4 Pu= 0 


v(x) H=Q (x) 


or 
whence 


Substituting into formula (2), we finally get 
y=v(x) | Larte] 


v (x) 
or 


y=v(x) i LO ay 4 Cu (x) (6) 


v (x) 


Note. It is obvious that expression (6) will not change if in 
place of the function v(x) defined by (5) we take some function 


v, = Cv (x). Indeed, putting v, (x) in (6) in place of v(x), we 
get 


y=Cuv (of a 7 dx + CCo (x) 


The C in the first term cancel out; in the second term the product 
CC is an arbitrary constant, which we shall denote by C, and we 
again arrive at expression (6). If we denote feo dx = (x), then 
expression (6) will take the form 

y =v (x) p (x) + Co (x) (6°) 


It is obvious that this is a complete integral, since C may be 
chosen in such a manner that the initial condition will be satisfied: 


when x=x%,, Y=Y 
The value of C is determined from the equation 
Ya =V (Xo) P (Xp) + Cv (Xp) 
Example. Solve the equation 


-rset 
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Solution. Putting 
y=uv 
we have ° 


dy _ d 


v , du 
te ae tae” 


Putting the expression dy into the original equation, we obtain 


dx 
dv , du 2 E 3 
“ata ere ee 
dv 2 du 
Be oe ees 2a 3 
“(z areg Gr) (7) 
To determine v we get the equation 
du 2 
a rpi”? 
that is, 
dv __ 2dx 
f v x+l 
whence 


Injolļ=2ln|x+1| o  v=(x4 1} 


Futting the expression of the function v into equation (7), we get the following 
equation for u: 


e+p E= or H+) 
whence 


u=} c 


Thus, the complete integral of the given equation will be of the form 
x-+1)4 
y= FE Ec (et 


The family obtained is the general solution. No matter what the initial con- 
dition (xo, yo), where x #—1, it is always possible to choose C so that the 
corresponding particular solution should satisfy the given initial condition. For 
example, the pa Uuta solution that satisfies the condition yọ=3 when x,=0 
is found as follows: 


g-Ot c 0+1) cae 


Consequently, the desired particular solution is 


4 
CES wi 


y= 


However, if the initial condition (x9, yo) is chosen so that x» =—1, we will 
not find the particular solution that satisfies this condition. This is due to the 
fact that when x,=— 1 the function P= 
ce, the conditions of the theorem of the existence of a solution are not observed. 


is discòntinuous and, hen- 
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Note. In applications, one frequently encounters linear equa- 
tions with constant coefficients: 


tay =b (8) 


where a and b are constants. 
This equation may be solved either by the substitution (2) or 
by separation of variables: 


d 1 
dy =(—ay+b)dx, — o=dx, —FIn|—ay+b|=x+C, 
In| —ay+6|=—(ax+C*), where C*=daC, 
+ 1 á b 
—ay +b =e7(%+0*), ee ate) 
or, finally, 
y=0e +2 


(where =Le =C) . This is the general solution of equation (8). 


1.8 BERNOULLI’S EQUATION 


We consider an equation of the form* 
d 
+P (x)y=Q(x)y” (1) 


where P(x) and Q(x) are continuous functions of x (or constants), 
and n=40 and n1 (otherwise we would have a linear equation). 
This equation is called Bernoulli’s equation and reduces to a linear 
equation by the following transformation. 

Dividing all terms of the equation by y”, we get 


yr Bt Py" = Q (2) 
Making the substitution 


we have 


* This equation results from the problem of the motion of a body provided 
the resistance of the medium F depends on the velocity: F=A,v-+A,u". 


The equation of motion will then assume the form mH = — hoho or 
dv An 


Aa 
—— 0 = — — yn 
dt Tm | P 
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Substituting into (2), we get 
Z +(—n$1)Pz=(—n+1)Q 


This is a linear equation. 
Finding its complete integral and substituting the expression 
y~"*! for z, we get the complete integral of the Bernoulli equation. 


Example. Solve the equation 


d 
oxy = 3p (3) 
Solution. Dividing all terms by y3, we have 
y?y + xy- = 2A (4) 
Introducing the new function 
z=y-? 
we get 
dz _ 3 4Y 
de — 79" Te 
Substituting these values into equation (4), we obtain the linear equation 
dz 
g e5 (5) 
Let us find its complete integral: 
, dz dv , du 
z=uv; de ae ae 
Put expressions z and = into (5): 


dv , du 
ue Taz u — 2xuv = — 2x8 
or 


dx 


Equate to zero the expression in the brackets: 


(2-20) 4oitm— ox 


du du 
ae 20 =0, ex de 


In|o|=x?, o=e* 
For u we get the equation 


et Hon 


Separating variables, we have 
du =— 2e- de, u=— 2 | e~*8x8de+C 


Integrating by parts, we find 
u=xte~x? | e-xF74.C, 
2=uu=x?+1+4 Cer? 
3 2082 
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Consequently, the complete integral of the given equation is 
1 
V x241 +Cer? 

Note. Just as was done for linear equations, it may be shown that 
the solution of the Bernoulli equation may be sought in the 
form of a product of two functions: 

y =u (x) v (x) 


where v(x) is some nonzero function that satisfies the equation 
v’ + Pu =0. 


y-?=x*+14Ce* or y= 


1.9 EXACT DIFFERENTIAL EQUATIONS 


Definition. The equation 
M (x, y)dx+N (x, y)dy=0 (1) 
is called an exact differential equation if M(x, y) and N(x, y) are 
continuous differentiable functions for which the following rela- 


tionship is fulfilled 
ðM ON 


“Oy Ox (2) 
and H and de are continuous in some region. 

Integrating exact differential equations. We shall prove that if 
the left side of equation (1) is an exact differential, then condi- 
tion (2) is fulfilled, and, conversely, if condition (2) is fulfilled 
the left side of equation (1) is an exact differential of some fun- 
ction u(x, y). That is, equation (1) is an equation of the form 

du(x, y)=0 (3) 
and, consequently, its complete integral is 
u(x, y)=C 

Let us first assume that the left side of (1) is an exact diffe- 

rential of some function u(x, y); that is, 


M (x, y)dx-+N (x, y) dy = du = Sede +S dy 


then 
Ou Ou 
Moa. MSG, (4) 
Differentiating the first relation with respect to y, and the 
second with respect to x, we obtain 


aM ðu  ƏN_ ðu 
Oy Oxdy’ x dyox 


1.9 Exact Differential Equations 35 


Assuming continuity of the second derivatives, we have 

OM ON, 

dy Ox 
that is, (2) is a necessary condition for the left side of (1) to be 
an exact differential of some function u(x, y). We shall show that 
this condition is also sufficient: if (2) is fulfilled then the left 
side of (1) is an exact differential of some function u(x, y). 

From the relation 


Ou 
ox M (x, Y) 


we find , 
u= M(x, ydx+q(y) 


Xo 


where x, is the abscissa of any point of the domain of existence 
of the solution. 

When integrating with respect to x we consider y constant, and 
therefore the arbitrary constant of integration may be dependent 
on y. Let us choose a function ọ (y) so that the second of the 
relations (4) is fulfilled. To do this, we differentiate* both sides 
of the latter equation with respect to y and eauate the result to 
N (x, y): 


x 
0 ðM , 
ay = ay tO (y) =N (x, y) 
Xo 
but since OM. 208 we can write 
Oy ox’ 


x 
ON , : , 
ay AX +’ (y)=N that is, N(x, ylz +p (yy =N (x, y) 


or 


N (x, Yy—N (xX. Y) +9’ (Y) =N (x, y) 
Hence, 


P’ (Y) =N (x, y) 


x 


* The integral f M (x, y)dx is dependent on y. To find the derivative of 
this. integral with “espect to y, differentiate the integrand with respect to y: 
sfm (x, n dem | ax. This follows from Leibniz’ theorem for difieren- 
tiating a definite integral with respect to a parameter (see Sec. 11.10. Vol. I). 


3% 
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or 
Y 


p(y) = | N(x, y)dy+C, 


Yo 
Thus, the function u(x, y) will have the form 


x y 
u =f M(x, ydx+§ N(x, ydy+C, 
Xo Yo 


Here P(x,, Ya) is a point in the neighbourhood of which there 
is a solution of the differential equation (1). 
Equating this expression to an arbitrary constant C, we get the 
complete integral of equation (1): 
x y 


| M(x, yde | N(x, y)dy=C (5) 
Xo Yo 
Example. Given ire equation 
2x y? — 3x? 
= dx- y dy=0 
Let us check to see whether this is an exact differential equation. 
Denoting 2 : 
M =5; N=” -x 


we have : 
aM__6e aN _ 6s 
ðy yt’ ox yt 


For y #0, condition (2) is fulfilled. Hence, the left side of this equation is 
an exact differential of some unknown function u(x, y). Let us find this function. 


non Ou 2x 
Since xe’ it follows that 


2 
u=( detou) =+) 


where ọ (y) is an as yet undetermined function of y. 
Differentiating this relation with respect to y and noting that 


ðu _ y? — 3x 
T y* 
we find i ` 3 
3x’ ; —3x 
EF +P w= 
hence A 
; l 
C u=. Pu) =— tC 
2 l 
u (x, VS Ao 
Thus the complete integral of the original equation is 
lc 


y 
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1.10 INTEGRATING FACTOR 
Let the left side of the equation ° 
M (x, y)dx+N (x, y)dy =0 (1) 


not be an exact differential. It is sometimes possible to choose 
a function p(x, y) such that after multiplying all terms of the 
equation by it the left side of the equation is converted into an 
exact differential. The general solution of the equation thus ob- 
tained coincides with the general solution of the original equation; 
the function p (x, y) is called the integrating factor of equation (1). 

In order to find the integrating factor u, do as follows. Mul- 
tiply both sides of the given equation by the as yet unknown 
integrating factor p: 


uM dx-+pN dy=0 
For this equation to be an exact differential equation, it is neces- 
sary and sufficient that the following relation be fulfilled: 
(uM) _ 9(uN) 
oy Ox 

that is, 

op ON ðu 
u tM ay hae t N= 
or 


ðu ou. (ON aM 
MEN =n (or) 


After dividing both sides of the latter equation by p, we get 
M2ink pyne oN oM 


oy Ox Ox oy (2) 


It is obvious that any function p(x, y) that satisfies this equa- 
tion is the integrating factor of equation (1). Equation (2) is 
a partial differential equation in the unknown function u depen- 
dent on the two variables x and y. It can be proved that under 
definite conditions it has an infinitude of solutions and that, con- 
sequently, equation (1) has an integrating factor. But in the gene- 
ral case, the problem of finding p(x, y) from equation (2) is har- 
der than the original problem of integrating equation (1). Only 
in certain particular cases does one manage to find the function 
u(x, y). 

For instance, let equation (1) admit an integrating factor depen- 
dent only on y. Then 

din o 

Ox 
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and to find » we obtain an ordinary differential equation, 
aN ðM 
Olnw ox ~ ay” 
“oy M 
from which we determine (by a single quadrature) In p, and, hence, 


u as well. It is clear that this can be done only if the expression 


ON _ƏM 
oe is not dependent on x. 
aN ðM 


Similarly, if the expression cD is not dependent on y but 


only on x, then it is easy to find an integrating factor that 
depends only on x. 
Example. Solve the equation 
(y -+ xy) dx — x dy =0 
Solution. Here, M=y+xy?, N=—x 
ôM o ON__, ƏMƏN 


Thus, the left side of the equation is not an exact differential. Let us see 
whether this equation allows for an integrating factor dependent only on y or 
not. Noting that 


we conclude that the equation permits of an integrating factor dependent 
only on y. We find it: 


whence 


Inu=—2lny, i.e. u= 


After multiplying through by the integrating factor u, we obtain the equation 


l ) x 
— -4x | dx———dy=0 
ii ye 4 


as an exact differential equation (==) . Solving this equation, 
dy Ox y? ) 
we find its complete integral: 
2a ey 
rae ay = 
or 
2x 


s=- aF 
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1.11 THE ENVELOPE OF A FAMILY OF CURVES 


Let there be an equation of the forme 
M(x, y, C)=0 (1) 


where x and y are variable Cartesian coordinates and C is a para- 
meter that can take on a variety of fixed values. 

For each given value of the pa- 

y rameter C, equation (1) defines some 

curve in the xy-plane. Assigning 

to C all possible values, we obtain 

a family of curves dependent on 


ZUR SALA AON 
II AT 


Fig. 7 Fig. 8 


a single parameter, or using the more common term, a one-para- 
meter family of curves. Thus, equation (1) is the equation of a 
one-parameter family of curves (because it contains only one arbit- 
rary constant). 

Definition. A curve L is called the envelope of a one-parameter 
family of curves if at each point it touches a curve of the family, 
and different curves of the given family touch the curve L at 
different points (Fig. 7). 

Example 1. Consider the family of curves 
(x— C} +y =R? 
where R is a constant and C is a parameter. 

This is a family of circles of radius R with centres on the x-axis. This 
family will obviously have as envelopes the straight lines y=R and y=—R 
(Fig. 8). 

Finding the equation of the envelope of a given family. Let 
there be given a family of curves, 


O (x, yY, C)=0 (1) 


that depend on the parameter C. 

Let us assume that this family has an envelope whose equation 
may be written in the form y= ọ (x), where g(x) is a continuous 
and differentiable function of x. We consider some point M (x, y) 
lying on the envelope. This point also lies on some curve of the 
family (1). To this curve there corresponds a definite value of the 
parameter C, which value is determined from equation (1), for 
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given (x, y): C=C (x, y). Thus, for all poe of the envelope the 
following equation holds: 


@[x, y, C(x, y)]=0 (2) 


Suppose that C(x, y) is a differentiable function that is not con- 
stant in any interval of the values of x and y under consideration. 
From equation (2) of the envelope we find the slope of the tan- 
gent to the envelope at the point M(x, y). Differentiate (2) with 
respect to x a that y is a function of x: 
oD aC oboc] , 
z +50 Ox! + + s| =0 
or 
, roe [C C , 
o + Oy +o, | +a] =0 (3) 
The slope of the tangent to the curve of the family (1) at the 
point M (x, y) is found from 
O,+ Oy = (4) 
(on this curve, C is constant). 
We assume that @, #0, otherwise we would consider x as the 
function and y as the argument. Since the slope & of the envelope 


is equal to the slope & of the curve of the family, from (3) and 
(4) we obtain 


o:[£+%y]-0 
But since on the envelope C(x, y) const, it follows that 
E+E yo 
and so for its points the following equation holds: 
Dc (x, y, C)=0 (5) 
Thus, the following two equations serve to determine the envelope: 
® (x, y, a \ 
5 (x, y, C)=0 J 9 
Conversely, if, by eliminating C from these equations, we get an 
equation y =ọ (x), where g(x) is a differentiable function and 


C= const on this curve, then y=ọ (x) is the equation of the 
envelope. 

Note 1. If for the family (1) a certain function y= ọ (x) is the 
equation of the locus of singular points, that is, of points where 


@;,=0 and P; =0, then the coordinates of these points also satisfy 
equations (6). 
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Indeed, the coordinates of singular points may be expressed 
in terms of the parameter C that entess into equation (1): 


x=1 (C), y=p (C) ‘ (7) 
If these expressions are substituted in equation (1), we get an 


identity in C: 


Differentiating this identity with respect to C, we obtain 

o +o, o= 
Since for any points the equalities D, =0, Þ;=0 are fulfilled, 
it follows that for them the equality Ðg =0 is alse satisfied. 

We have thus proved that the coordinates of singular points 
satisfy equations (6). 

Summarizing, equations (6) define either the envelope or the 
locus of singular points of the curves of the family (1), or a 
combination of both. Thus, after obtaining a curve that satisfies 
equations (6), one has further to find out whether it is an envelope 
or the locus of singular points. 


Example 2. Find the envelope of the family of circles 
(x—C)* + —R=0 


that are dependent on the single parameter C. 
Solution. Differentiating the equation of the family with respect to C, 


we get 
2(x—C)=0 
Eliminating C from these two equations, we obtain the equation 
y*—R?=0 or y=iR 


It is clear, by geometric reasoning, that the pair of straight lines is the 
envelope (and not the locus of singular points, since the circles of a family 
do not have singular points). 

Example 3. Find the envelope of the family of straight lines 


xcosa+ysina—p=0 (a) 
where @ is a parameter. 


Solution. Differentiating the given equation of the family with respect 
tu a, we have 


—xsina+ycosa=0 (b) 
To eliminate the parameter œ from equations (a) and (b), multiply the 
terms of the first by cosa, and of the second, by sina, and then subtract 
the second from the first; we then have 
x=pcosa@ 
Putting this expression into (b), we find 
y=psina 
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Squaring the terms of the last two equations and adding termwise, we get 
x24 y?=p? 


This is a circle. It is the envelope of the family (and not the Iccus of singular 
points, since straight lines do not have singular points) (Fig. 9). 

Example 4. Find the envelope of the trajectories of projectiles fired from 
a gun with velocity uv, at different angles of inclination of the barrel to the 
horizon. We shall consider that the gun is located at the coordinate origin and 
a ahe trajectories of projectiles lie in the xy-plane (air resistance is disre- 
garded). 


Fig. 9 


Solution. First find the equation of the trajectory for the case’when the barrel 
makes an angle œ with the positive x-axis. In flight, the projectile participates 
simultaneously in two motions: a uniform motion with velocity vo in the direc- 
tion of the barrel and a falling motion due to the force of gravity. Therefore, 
at each instant of time ¢ the position of the projectile M (Fig. 10) will be 
defined by the equations 


X= Vot COS Q 


These are parametric equations of the trajectory (the parameter is the time £). 
Eliminating t, we get the equation of the trajectory in the form 


gx? 


y =x tana ——_.2—_ 
Qué cos? a 


Finally, introducing the notation tan a=k, =a, we get 
0 
y = kx — ax? (1 4- k?) (8) 
This equation defines a parabola with vertical axis pa ine through the origin 
and concave down. We obtain a variety of trajectories for the different values of k. 
Consequently, equation (8) is the equation of a one-parameter family of para- 
bolas, which are the trajectories of a projectile for different: angles æ and for 
a given initial velocity up (Fig. 11). 
Let us find the envelope of this family of parabolas. Differentiating both 
sides of (8) with respect to k, we have 
x—2akx? =0 (9) 


Eliminating k from equations (8) and (9), we get 


l 
=— —ax? 
y=; 
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This is the equation of a parabola with vertex at the point (o, the axis 


i 

o 4a)’ 
of which coincides with the y-axis. It is not # locus of singular points [since 
parabolas (8) do not have singular points]. Thus, the parabola 


is the envelope of the family of trajectories. It is called a safety parabola be- 
cause no point outside it is in reach of a projectile fired from a given gun with 
a given initial velocity up. 


Example 5. Find the envelope of the family of semicubical parabolas 
y? —(x—C)?=0 


Locus of singular |points 
Fig. 12 


Solution. Differentiate the given equation of the family with respect to the 
parameter C: 


2(x—C)=0 
Eliminating the parameter C from the two equations, we get 
y=0 


The x-axis is a locus of singular points—a cusp of the first kind (Fig. 12). 
Indeed, let us find the singular points of the curve 


yi— (x) =0 
for a fixed value of C. Differentiating with respect to x and y, we find 
Fy =—2(x—C)=0 
Fy=3y?=0 
Solving the three foregoing equations simultaneously, we find the coordinates 
of the singular point: x=C, y=0; thus, each curve of the given family has 
a singular point on the x-axis. 


For continuous variation of the parameter C, the singular points will fill the 
entire x-axis. 


44 Ch. 1 Differential Equations 


Example 6. Find the envelope and locus of singular points of the family 
(y—Cr—F -C =0 (10) 
Solution. Differentiating both sides of (10) with respect to C, we find 
. —2(y—C)+ 3—0) =0 


or 
y—C—(x—C)*=0 (11) 


Fig. 13 Fig. 14 


Now eliminate the parameter C from (11) and from the equation (10) of the 
family. Putting the expression 
y—C=(x—C)? 


into the equation of the family, we get 

(x —C)4#— Zeep =0 
or 

(x—C)? [«-o-4| =0 


whence we obtain two possible values of C and two solutions of the problem 
corresponding to them. 


First solution: Second solution. 
2 
C=x C=x—5 
and so from (11) we find and so from (11) we find 
2 
y—x—(x—x)?=0 y—x4+5~ [s-*+4] =0 
or or 
2 
y= y=x—- y 


9 
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We have obtained two straight lines: y =x and yar}. The first is the locus 
of singular points, the second is the envelope (Fig. 13). 


Note 2. In Sec. 6.7, Vol.I it was proved that the normal to a 
curve serves as a tangent to its evolute. Hence, the family of 
normals to a given curve is at the same time a family of tangents 
to its evolute. Thus, the evolute of the curve is the envelope of the 
family of normals of this curve (Fig. 14). 

This remark enables us to point out another method for finding 
evolutes: to obtain the equation of an evolute, first find the family 
of all normals of the given curve and then find the envelope of 
this family. 


1.12 SINGULAR SOLUTIONS OF A FIRST-ORDER 
DIFFERENTIAL EQUATION 


Let the differential equation 


d 
F(x, y, #)=0 (1) 
have a complete integral 
D(x, y, C)=0 (2) 


Let us assume that the family of integral curves that corresponds 
to equation (2) has an envelope. We shall prove that this envelope 
is also an integral curve of the differential equation (1). 

Indeed, at each point the envelope touches some curve of the 
family; that is, it has a common tangent with it. Thus, at each 
common point the envelope and the curve of the family have the 
same values of x, y, y 

But for a curve of the family, the numbers x, y, and y’ satisfy 
equation (1). Consequently, the very same equation is satisfied by 
the abscissa, the ordinate and the slope of each point of the 
envelope. But this means that the envelope is an integral curve 
and its equation is a solution of the given differential equation. 

Since, generally speaking, the envelope is not a curve of the 
family, its equation cannot be obtained from the complete inte- 
gral (2) for any particular value of C. The solution of the differential 
equation which is not obtained from the complete integral for any 
value of C and which has as its graph the envelope of the family 
of integral curves entering into the general solution, is called a 
singular solution of the differential equation. 

Let the complete integral be known: 


M(x, y, C)=0 
eliminating C from this equation and from the equation Me; (x, y,C)=0, 


we get p(x, y)= 0. If this function satisfies the differential equation 
{and does not belong to the family (2)], then it is a singular integral. 
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It should be noted that at least two integral curves pass through 
each point of the curve that describes a singular solution; that is, 
uniqueness of solution is violated at each point of a singular 
solution. 

We note that a point at which uniqueness of solution of a diffe- 
rential equation has been violated, that is, a point through which 
at least two integral curves pass, is called a singular point *. Thus, 
a singular solution consists of singular points. 


Example. Find a singular solution of the equation 


y2(I+y)=R (x) 
Solution. Let us find its complete integral. We solve the equation for y’: 
dy _ VRZ} 
dx y 
Separating variables, we obtain 
fe ae 
+VR-¥ 


Whence, integrating, we find the complete integral: 
(x—C)?+ y= R? 


It is easy to see that the family of integral lines is a family of circles of 
radius R with centres on the x-axis. The pair of straight lines y= + R will 
be ‘the envelope of the family of curves. 

The functions y=+R satisfy the differential equation (+). This, conse- 
quently, is a singular integral. 


1.13 CLAIRAUT’S EQUATION 
Let us consider the so-called Clairaut equation: 
dy d 
v=% +o (2) (1) 
It is integrated by introducing an auxiliary parameter. Put % — P; 
then equation (1) will take the form 
y=xp +4 (p) (1’) 
Differentiate all the terms of this equation with respect to x, 
bearing in mind that p=% is a function of x: 


p=xE+p+y (p) 


* The boundary points of the domain of existence of a solution are also 
termed singular points. An interior point through which a unique integral curve 
of a differential equation passes is called an ordinary point. 
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or 
, d, 
K+ E= 
Equating each factor to zero, we get 


PO (2) 


x+y (p)=0 (3) 


(1) Integrating (2) we obtain p=C (C= const). Putting this 
value of p into (1’), we find its complete integral: 


y=xC +4 (C) (4) 
which, geometrically, is a family of straight lines. 


(2) If from (3) we find p as a function of x and put it into 
(1’), we obtain the function 


y = xp (x) +4 [p (x)] (1°) 
which may be readily shown to be the solution of equation (1). 
Indeed, by virtue of (3), we have 
d ; dp . d 
S=pt[x+' (pF, ie. Z=p 


And so, by substituting the function (1”) into equation (1) we get 


the identity 
xp +4 (p)=xp + (p) 


The solution (1”) is not obtained from the complete integral (4) 
for any value of C. This is a singular solution; it is obtained by 
elimination of the parameter p from the equations 


y=xp +4 (P) | 
x+ (P)=0 J 
or, which is the same thing, by eliminating C from the equations 
y =xC +4 (C) 
x+c(C)=0 


Thus, the singular solution of Clairaut’s equation defines the 
envelope of a family of straight lines represented by the complete 
integral (4). 


Example. Find the general and singular solutions of the equation 


and 
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Solution. The general solution is obtained by substituting C for a 
aC 
AET 


To obtain the singular solution, differentiate the latter equation with res- 
pect to C: 


y=xC+ 


a 


x+—-—_=0 
a+c)? 


The singular solution (the equation of the envelope) is obtained in parametric 
form (where the parameter is C): 


a 
y ane? 
(1 +C?) ? 
ye aC3 
3 
(1+ C3)? 


Eliminating C, we get a direct relationship be- 
tween x and y. Raising both sides of each equa- 
tion to the power 2 and adding the resultant 
equations termwise, we get the singular solution 
in the following form: 

ae es 

x +y? =a? 
This is an astroid. However, the envelope of the 
family (and, hence, the singular solution) is not 
the entire astroid, but only its left half (since it is evident from the parametric 
equations that x< 0) (Fig. 15). 


Fig. 15 


1.14 LAGRANGE’S EQUATION 
The Lagrange equation is an equation of the form 
y= xp (y') +H (4°) (1) 
where ọ and p are known functions of A 


This equation is linear in y and x. Clairaut’s equation, which 
was considered in the preceding section, is a particular case of 
the Lagrange equation when ọ(y')=y'. The Lagrange equation, 
like Clairaut’s, is integrated by means of introducing an auxiliary 
parameter p. Put 

y =p 


then the original equation is written in the form 


y = xp (p) + (p) (1’) 
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Differentiating with respect to x, we obtain 


p=9(p) + [x9' (+E 


or 
p—9(p)=[x9' (+Y WIE (1°) 


From this equation we can straightway find certain solutions: 
namely, it becomes an identity for any constant value p= p, 
that satisfies the condition 


Po— 9 (Po) =0 


Indeed, for a constant value p the derivative 2 =0, and both 
sides of equation (1”) vanish. 
The solution corresponding to each value p= p, that is, t- Po 


is a linear function of x (since the derivative S is constant only 


in the case of linear functions}. To find this function it is suf- 
ficient to put into (1’) the value p= p: 


Y = X@ (Po) +4 (Po) 


If it turns out that this solution is not obtainable from the gener- 
al solution for any value of the arbitrary constant, it will be a 
singular solution. 
Let us now find the general solution. Write (1”) in the form 
dx P) (p) 


dp P—@(p) p—ọ (p) 


and regard x as a function of p. Then the equation obtained 
will be a linear differential equation in the function x of p. 
Solving it, we find 


x= (p, C) (2) 


Eliminating the parameter p from equations (1°) and (2), we 
get the complete integral of (1) in the form M(x, y, C)=0. 


Example. Given the equation 


y= xy +y" (I) 
Putting y’=p we have 
y= xp? +p? (r) 
Differentiating with respect to x, we get 
d 
p= p+ [2x0 +2) 7 a’) 


4 -2082 
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Let us find the singular solutions. Since p= p? for pọ=0 and p,=1, the 
solutions will be linear functions [see (1')]: 


y=x-0?+0?, that is, y=0 


y=x+1 
When we find the complete integral, we will see whether these functions are 
particular or singular solutions. To do so, write equation (I") in the form 
Git gow s 
dp “1—p 1—p 
and regard x as a function of the independent variable p. Integrating this 
linear (in x) equation, we find 


and 


2 
=+ (II) 
Eliminating p from equations (I’) and (II), we get the complete integral 
y=(C-+ Vx ip 
The singular integral of the original equation is 
y=0 


anes this solution is not obtainable from the general solution for any value 
of C. 

However, the function y=x-+1 is not a singular but a particular solution; 
it is obtained from the general solution when C=0. 


1.15 ORTHOGONAL AND ISOGONAL TRAJECTORIES 


Suppose we have a one-parameter family of curves 
® (x, y, C)=0 (1) 


Lines intersecting all the curves of the given family (1) at a 
constant angle are called isogonal trajectories. If this angle is 
a right angle, they are orthogonal trajectories. 

Orthogonal trajectories. Let us find the equation of orthogonal 
trajectories. Write the differential equation of the given family of 
curves, eliminating the parameter C oe the equations 


D(x, y, C)= 
and 
22 ðD dy _ 
Fx oy dy dx 
Let this differential as be 
d , 
F(x, y, #)=0 (1') 


Here, # is the slope of the tangent to some member of the 
family at the point M(x, y). Since an orthogonal trajectory pass- 
ing through the point M (x, y) is perpendicular to the correspond- 
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ing curve of the family, the slope of the tangent to it, wr, is 


connected with Æ by the relation (Fig. 16) 


dy _ 1 
de de a 
dx 


Putting this expression into equation (1’) and dropping the 
subscript T, we get a relationship between the coordinates of an 
arbitrary point (x, y) and the slope of the orthogonal trajectory 
at this point, that is, a differential 
equation of orthogonal trajectories: 


1 
ae Y, Zg)’ (3) pi 
dx 

The complete integral of this equa- Micy) 

tion 
D, (x, y, C)=0 

yields a family of orthogonal trajec- 
tories. 

A consideration of the plane flow 
of a fluid involves orthogonal trajec- 
tories. , 

Let us suppose that the flow of Fig 16. 
fluids in a plane takes place in such 
a manner that at each point of the xy-plane the velocity vec- 
tor w(x, y) is defined. If this vector depends solely on the 
position of the point in the plane, but is independent of the 
time, the motion is called stationary or steady-state. We shall 
consider such motion. In addition, we shall assume that there 
exists a potential of velocities, that is, a function u(x, y) such 
that the projections of the vector w(x, y) on the coordinate axes, 
V o y) and v, (x, y), are its partial derivatives with respect to x 
and y: 


0 ð 
A =U, 5 =U, (4) 
The lines of the family 
u(x, yy=C (5) 


are called equipotential lines (lines of equal potential). 

The lines, whose tangents at all points coincide with the 
vector v(x, y), are called flow lines and yield the trajectories of 
moving points. 

We shall show that the flow lines are the orthogonal trajecto- 
ries of a family of equipotential lines (Fig. 17). 
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Let @ be an angle formed by the velocity vector ọ with the 
x-axis. Then, by relation (4), 


UE. _| 9|cos@, wE Y)—|o|sing 
whence we find the slope of the tangent to the flow line 
Ou (x, y) 
0. 
tanp = rey (6) 
Ox 


We obtain the slope of the tangent to the equipotential line by 
differentiating relation (5) with respect 
to x: 


Ou , Ou dy _ 
ox | dydx 
whence 
ðu 
dy _ Ox 
dx ou (7) 
oy 
Thus, in magnitude and sign, the slope 
Fig. 17 of the tangent to the equipotential line is 


the inverse of the slope of the tangent to 
the flow line. Whence it follows that equipotential lines and flow 
lines are mutually orthogonal. 
In the case of an electric or magnetic field, the lines of force 
of the field serve as the orthogonal trajectories of the family of 
equipotential lines. 


Example 1. Find the orthogonal trajectories of the family of parabolas 


y=Cx* 
Sotution. We write the differential equation of the family: 
y’ =2Cx 
Eliminating C, we get 
r2, 
Yy x 


Substituting ai for y’, we obtain a differential equation of the family of 
orthogonal trajectories 


or 
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Its complete integral is 
l Car _¢ 
4'2 d 


Hence, the orthogonal trajectories of the given family of parabolas will be 


E 18) by a certain family of ellipses with semi-axes a=2C, b=C V32 
ig. 18). 


Fig. 18 


Isogonal trajectories. Let the trajectories cut the curve of a 
given family at an angle a, where tana =k. 

The slope % — tang (Fig. 19) of the tan- 
gent to a member of the family and the slope 
ar — tanp to the isogonal trajectory are 
connected by the relationship 
tan p—tana 
1+tana tan p 
that is, dyr = 


d , 
W- a (2’) Fig. 19 


tan g = tan (p—a) = 


Substituting this expression into equation (1’) and dropping the 
subscript T, we obtain the differential equation of isogonal tra- 
jectories. 
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Example 2. Find the isogonal trajectories of a family of straight lines, 
y=Cx (8) 


hats cate the lines of the given family at an angle a, the tangent of which 

equals k. 

j Solution. Let us write the differential equation of the given family. Diffe- 
pene equation (8) with respect to % 
we fin 


dy _ 
ane 
On the other hand, from the same equa- 
tion we have 
cat 
x 


Consequently, the differential equation 
of the given family is of the form 
dy_ y 


dx x 


Utilizing relationship (2’) we get the 
Arenu equation of isogonal trajec- 
ories 


dyr 
N) 
dyry; * 
kH 
whence, dropping the subscript T, we find 
y 
ay tty 
Ge ype 
x 


Integrating this homogeneous equation, we get the complete integral: 
In VEF =+ arc tan Ž4in C (9) 


which defines the family of isogonal trajectories. To find out precisely which 
curves enter into this family, let us change to polar coordinates: 


#=tang, V x2 += p 
Substituting these expressions into (9), we obtain 
In p=tetin Cc 


2 
p=Ce* 


Consequently, the family of isogonal trajectories is a family of logarithmic 
spirals (Fig. 20). 
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1.16 HIGHER-ORDER DIFFERENTIAL EQUATIONS 
(FUNDAMENTALS) 


As has already been indicated above (see Sec. 1.2), a differen- 
tial equation of the nth order may be written symbolically in 


the form ; 
F (x, y, y', Y, wees y™)=0 (1) 
or, if it can be solved for the nth derivative, 
y™ = f(x, yY, y’, y", Er y”-») a’). 


In this chapter we shall consider only such equations of higher 
order that may be solved for the highest derivative. For these 
equations we have a theorem on the existence and uniqueness of 
a solution, similar to the corresponding theorem on the solution 
of first-order equations. 

Theorem. /f in the equation 


y=f(x, Y, Y's, ees Ym”) 


the function f(x, Y, Y', ..., yer") and its partial derivatives with 
respect to the arguments y, y’, ..., y"~" are continuous in some 
region containing the values x= Xo - FSi Y =Y, 

y\"-) = y"-), then there is one and only one solution, y= y(x), of 
the equation that satisfies the conditions 


Yun, = Yo (2) 
Wed = yg- -1) 
These conditions are called initial conditions. The proof is beyond 
the scope of this book. 

If we consider a second-order equation y" =f (x, y, y’), then the 
initial conditions for the solution, when x= x, wil 


Y = Yo Y= Yo 


where xX), Yo Yo are given numbers, these conditions have the fol- 
lowing geometric meaning: only one curve passes through a given 
point (x), Yọ) of the plane with given tangent of the angle of 
inclination of the tangent line yj. From this it follows that if we 
want to assign different values of y, for constant x, and y,, we 
get an infinitude of integral curves with different angles of incli- 
nation passing through the given point. 

We now introduce the concept of a general solution of an equa- 
tion of the nth order. 
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Definition. The general solution of a differential equation of the 
nth order is a function 
y= (x, C,» Ca, ...s Ca) 


which is dependent on n arbitrary constants C,, C,, ..., C, and 
such that: 
(a) it satisfies the equation for any values of the constants 


‘(b) for specified initial conditions 


Yxaxy— Yo 

Yur, = Yo 

Yim, = Ys"? 
the constants C,, C,, ..., C, may be chosen so that the func- 
tion y=ọ (x, Ci, Ca ..., Cna) will satisfy these conditions (on the 
assumption that the initial values x,, Yə Yo .--, y} belong 


to the region where the conditions of the existence of a solution 
are fulfilled). 

A relationship of the form ® (x, y, C,, Ca ..., C,)=0, which 
implicitly defines the genera] solution, is called the complete 
integral of the differential equation. 

Any function obtained from the general solution for specific 
values of the constants C,, Ca, ..., Ca is called a particular 
solution. The graph of a particular solution is called an integral 
curve of the given differential equation. 

To solve (integrate) a differential equation of the nth order 
means: 

(1) to find its general solution (if the initial conditions are not 
given) or 

(2) to find a particular solution of the equation that satisfies 
the given initial conditions (if there are such). 

In the following sections we shall present methods of solving 
various equations of the nth order. 


1.17 AN EQUATION OF THE FORM y= f(x) 
The simplest type of equation of the nth order is of the form 


y™ = f(x) (1) 
Let us find the complete integra! of this equation. 
Integrating the left and right sides with respect to x and 
taking into account that y™ = (y"-»)’, we obtain 
x 
y-» = | f(x)dx+C, 


Xo 
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where x, is any fixed value of x, and C, is the constant of 
integration. è 
Integrating once more, we get 


yf) = f(E rw dx )de+¢, (x— x.) +C: 


Xo ‘Xo 


Continuing, we finally get (after n integrations) the expression of 
the complete integral: 


x x 
C. oes n=l P n-2 
w= Ses ( Fx) ae. ..de +p HAE +, oa + eee. 


In order to find a particular solution satisfying the initial condi- 
tions 
Yea = Yor rox, = Yor WEY = yr 
it is sufficient to put 
Crn = to, Cr-1= 9» eiS C,=y977! 
Example 1. Find the complete integral of the equation 
y” = sin (kx) 

and a particular solution satisfying the initial conditions 


Vym =O Vieng =! 
Solution, 


x 
v=f sin kx dx + Cy =—— p 4.0, 


0 
pa È (SH) aot foarte, 


or 


sinkx , x 
y=— pr Ett Cs 


This is the complete integral. To find a particular solution satisfying the 
given initial conditions, it is sufficient to determine the corresponding values 
of C, and C}. 

From the condition y,_, =0, we find C,=0. 

From the condition y¿ =l, we find C,=1. 

Thus, the desired particular solution is of the form 


sin kx 


y= — SE +t( 4+!) 


Differential equations of this kind are encountered in the theory of the 
bending of girders. 

Example 2. Let us consider an elastic prismatic girder bending under the 
action of external forces both continuously distributed (weight, load) and con- 
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centrated. Let the x-axis be horizontal along the axis of the girder in its un- 
derformed state and let the y-axis be directed vertically downwards (Fig. 21). 
Each force acting on the girder (the load of the girder, and the reaction of 
the supports, for instance) has a moment, relative to some cross seetion of the 
girder, equal to the product of the force by the distance of the point of appli- 
cation of the force from the given cross sec- 
ticn. The sum, M (x), of the moments of all 
the forces applied to that part of the girder 
situated to one side of the given cross section 
with abscissa x is called the bending moment 
of the girder relative to the given cross sec- 
tion. In courses of strength of materials, 
it is proved that the bending moment of the 
girder is 
EJ 
R 


Fig. 21 where E is the so-called modulus of elasticity 

which depends on the material of the girder, 

J is the moment of inertia of the cross-secti- 

onal area of the girder relative to the horizontal line passing through the centre 

of gravity of the cross-sectional area, and R is the radius of curvature of the 

a o the bent girder, which radius is expressed by the formula (Sec. 6.6, 
ol. I) 


fg (las i 
R |y” | 
Thus, the diferentia? equation of the bent axis of a girder has the form 
y” M (x) 
am — 2 
aty” E9 z 


If we consider that the deformations are small and that the tangents to 
the axis of the girder, when bent, form a small angle with the x-axis, we can 
disregard the square of the small quantity y’* and consider 


R= 
y 
Then the differential equation of the bent girder will have the form 
„_ M(x) , 


but this equation is of the form of (1). 

Example 3. A girder is fixed in place at the extremity O and is subjected 
to the action of a concentrated vertical force P applied to the end of the 
girder L at a distance / from O (Fig. 21). The weight of the girder is ignored. 

We consider a cross section at the point N (x). The bending moment rela- 
tive to section N is, in the given case, equal to 


M (x)= (l— x) P 
The differential equation (2’) has the form 


PARNE z 


y =pl» 
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The initial conditions are: for x=0 the deflection y is equal to zero and the 
tangent to the bent axis of the girder coincides with the x-axis; that is, 


Yx=0 = 9, Yso 9 


Integrating the equation, we find 


io. P et Pai x? 
y =f f d-a = By le 7) 
0 
-2 or 
bogey |" -5 ) (3) 


In particular, from formula (3) we determine the deflection A at the extre 
mity of the girder L: 


PP 


h= Yrot= BE] 


1.18 SOME TYPES OF SECOND-ORDER DIFFERENTIAL 
EQUATIONS REDUCIBLE TO FIRST-ORDER EQUATIONS. 
ESCAPE-VELOCITY PROBLEM 


I. An equation of the type 
æ d 
T= (x F) (1) 
does not explicitly contain the unknown function y. 


Solution. Let us denote the derivative a by p, that is, we set 


Putting these expressions of the derivatives into equation (1), 
we get a first-order equation, 


dp yy. 

dx / (x, p) 
in the unknown function p of x. Integrating this equation, we 
find its general solution: 

p=p(x,C,) 


and then from the relation “4 = p we get the complete integral 


E 
of equation (1): 
y= f p(x, Ci)dx+C, 


Example 1. Let us consider the diferential equation ot a catenary (see 
Sec. 1.1): 

ay l / : , 

dena Vl ae, 
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Set P 
1 
a ? 
then 
dy _dp 
dx? dx 


and we get a first-order differential equation in the auxiliary function p of x: 
dp_ 1 3 
dea ViHP 
Separating variables, we have 
dp __dx 
Vite a 
x 
In (P+ Vi+p*) Sas 
p=sinh (ž+c) 


But since p=%, the latter relation is a diferential equation in the sought- 


whence 


or function y. Integrating it, we obtain the equation of a catenary (see 
. 1.1): 


y=acosh (4+¢,)+¢, 
Let us find the particular solution that satisfies the following initial con- 
ditions: 

Yz=0 = 4 

Yeo = 0 
The first condition yields C,=0, the second, C,=0. 
We finally obtain 

x 
y=acosh (ž) 


Note. We can similarly integrate the equation 
y= f (x, y") 


Setting y"- =p, we get for a determination of p the first- 
order equation 


Pfr, p) 


From here we get p as a function of x, and from the relation 
y"-) =p we find y (see Sec. 1.17). 
II. An equation of the type 


=i) (2) 


does not contain the independent variable x explicitly, 
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To solve it, we again set 
aP ý (3) 


but now we shall consider p as a function of y (and not of x, 
as before). Then 


dy dp _dpdy_ dp 


Putting into (2) the expressions Y and zo we get a first- 


order equation in the auxiliary function p: 
d 
pT TU p) (4) 


Integrating it, we find p as a function of y and the arbitrary 
constant C,: 


p=p(y, C,) 
Substituting this value in (3), we get a first-order differential 
equation for the function y of x: 

d 

T=pl, C) 


Separating variables, we have 
dy 
P (4, Cı) E 


Integrating this equation, we get the complete integral of the 
initial equation: 
@ (x, y, C,, Ca) =0 


Example 2. Find the complete integral of the equation 


dx 


5 


3y”"=y 3 
dy A ; s dp 
Solution. Put aaa and consider p as a function of y. Then y =P j; 
and we get a first-order equation for the auxiliary function p: 
5 
dp_ 3 
Spay 


Integrating this equation, we find 


pt=Ci—y ®© o p=4V Cyh 


But p=%; consequently, for a determination of y we get the equation 
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whence 


, 
iG = wes 
V Cy la] 


To compute the latter integral we make the substitution 


Ciy l =t 


Then 
1 
Vs qp2 Tal, 
y = (t?+ 1) Ch 
‘ l 
dy=3t (241): a7, at 
1 
Consequently, 
‘lad. 1 (3¢ (¢2+-1) 3 (# LVE Tr, 
sy L ETD t Eaa =V C—C) 
Ia al ' ae) ao? 


Finally we get 


1 — 
xX+Cg= to V Cig] (Ciy +2) 
1 


Example 3. Let a point move along the x-axis under the action of a force 
that depends solely on the position of the point. The differential equation of 
motion will be m 

x 


At t=0 let x= xp, Zu. 


Multiplying both sides of the equation by Bat and integrating from 0 to £, 
we have 


x 

\2 

ra) -7 meg = È F ds 
Xo 


or 
1 dx\2 4 
z” (F) s|- frw a|- mv? = const 
Xo 


The first term of this equation is the kinetic energy, the second term, the 
potential energy of the moving point. From this equation it follows that the 
sum of the kinetic and potential energies remains constant throughout the time 
of motion. 

The problem of a simple pendulum. Let there be a material point of mass m, 
which is in motion (due to the force of gravity) along a circle L lying in the 
vertical plane. Let us find the equation of motion of the point neglecting resis- 
tance forces (friction, air resistance, etc.). 
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Putting the origin at the lowest point of the circle, we put the x-axis along 
the tangent to the circle (Fig. 22). 

Denote by / the radius of the circle, by s thg arc length from the origin O 
to the variable point M where the mass m is located; this length is taken with 
the appropriate sign (s>0, if the point M is on 
the right of O; s <0 if M is on the left of O). 

Our problem consists in establishing s as a function 
of the time 7. Á 

Let us decompose the force of gravity mg into 
tangential and normal components. The former, equal 
to —mgsing, produces motion, the latter is can- 
celled by the reaction of the curve along which the 
mass m is moving. 


Thus, the equation of motion is of the form 
G sin 
Map ES 


Since the angle => for a circle, we get the equation 


oe sin = 
a esn] 
This i a Type Dereita equation (since it does not contain the independent 
variable ¢ explicitly). 
Let us integrate it in the appropriate fashion: 
ds g s dh 
dt” dp dsP 


Hence, 
lo sin = 
Pas 8 l 
or 
. Ss 
pdp=—gsin 74s 
whence 


p? = 2gl cos F+e, 
Let us denote by sọ the greatest arc length to which the point M swings. 
For s=so the velocity of the point is zero: 
ds 
dt 
This enables us to determine C}: 
0 = 2g! cos M4 


S=So 


whence 
Cı = —2gl cos = 


Therefore, 
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or, applying to the last expression the formula for the difference of cosines, 


ds\? __ . S+ So . Sg—S 
(F) =4gl sin a -a (5) 
or* 
ds _ V . S+Sq .. Sy—S 6 
aa? Vel sin =g sin #7 (6) 
This is an equation with variables separable. Separating the variables, we get 
& =2 Vela (7) 


» S+ So |; So—S 
V sine sin zI 


We shall assume, for the time being, that s 4s), then the denominator of the 
fraction is different from zero. If we consider that s=0 for ¢=-0, then from (7) 
we get 

s 


er a ee as Valt (8) 
y sin S+ So sin So—S 
v 21 2l 


This is the equation that yields s as a function of ¢. The integral on the left 
cannot be expressed in terms of elementary functions; neither can the function 
s of t. Let us consider this problem approximately. We shall assume that the 
angles $ and $ are small. The angles STS 1 
In (6) let us replace, approximately, the sines of the angles by the angles 


and S will not exceed $. 


ds _ S+ So So —S 
gam? Ve! V aA l 


d P e 
Bay £Va-a 6’) 


Separating variables, we get (assuming, for the time being, that s Æ sọ) 


ds 
a g , 
yap- V $4 o 


Again we consider that s=0 when ¢=0. Integrating this equation, we get 


[= $i 6 
V si—s? 
0 
or 
arcsin — = £ 
0 l 
whence 


s=s sin Vz t (9) 


* We take the plus sign in front of the root. From the note at the end of 
the solution it follows that there is no need to consider the case with the mi- 
nus sign. 
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Note. When solving, we assumed that s Æ sy. But it is clear, by direct sub- 
stitution, that the function (9) is the solution of equation (6’) for any value of £. 

Let it be recalled that the solution (9) is an approximate solution of equa- 
tion (5), since equation (6) was replaced by the approximate equation (6’). 

Equation (9) shows that the point M (which may be regarded as the extre- 


mity of the pendulum) performs harmonic oscillations with a period T = 2n yt . 


This period is independent of the amplitude sọ. 
Example 4. Escape-velocity problem. 
Determine the smallest velocity with which a body must be thrown verti- 
cally upwards so that it will not return to the earth. Air resistance is neglected. 
Solution. Denote the mass of the earth and the mass of the body by M 
and m respectively. By Newton's law of gravitation, the force of attraction f 
acting on the body m is 
M.m 
re 


f=k 


where r is the distance between the centre of the earth and the centre of gra- 
vity of the body, and & is the gravitational constant. 
The differential equation of motion of this body with mass m will be 


dr k M.m 
aT tE 
a d M 
T 
= ta (10) 


‘The minus sign indicates that the acceleration is negative. The differential 
equation (10) is an equation of type (2). We shall solve it for the following 
initial conditions: 


dr 
for ¢=0 r=R, a 
Here, R is the radius of the earth and vg is the launching velocity. We denote 
dry,  Pr_ dv do dr do 
di” aa dr“ dt ° dr 
where v is the velocity of motion. Putting this into (10), we get 
do M 
GF a 
Separating variables, we obtain 
vdo=—kM £ 
r 
Integrating this equation, we find 
v? 1 
cg ne (H) 


From the condition that v =v at the earth’s surface (for r = R}, we determine Ci 


or 
RM v 
a= Ta 


5- 2082 


66 i Ch. 1 Differential Equations 


We put the value of C, into (11): 


or 

2 2 

Z =hM ++($-%) (12) 
It is ae that the body should move so that the velocity is always positive; 
hence, —- 7>? 0. Since for a boundless increase of r the quantity ms becomes 


arbitrarily small, the condition © Es 0 will be fulfilled for any r only for the 


2 
case 
2 kM 
U9 et 0 
i> (13) 
or 


Hence, the lowest velocity will be ~. .cimined by the equation 
2kM 
v= y= (14) 


k= 6.66-10-8 cm3/g.sec? 
R=63-107 cm 


At the earth’s surface, for r= R, the acceleration of gravity is g (g =981 cm/sec?). 
For this reason, from (10) we obtain 


where 


or 


Putting this value of M into (14), we obtain 
p= V 2gR = V 2-981 -63-107 ~ 11.2-105 cm/sec = 11.2 km/sec 


1.19 GRAPHICAL METHOD OF INTEGRATING 
SECOND-ORDER DIFFERENTIAL EQUATIONS 
$ 


Let us find out the geometric meaning of a second-order differ- 
ential equation. Suppose we have an equation 


y'=} (x, y, y') (1) 
Denote by ọ the angle formed by the positive x-axis and the 
tangent to the curve; then 


dy 
== tang (2) 
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To find the geometric meaning of the second derivative, recall 
the formula that determines the radius of curvature of a curve at 
a given point: * ° 


Uya" 
R lama y” 


whence 
„_(U+y3h 

f= 

But 
y’=tang, 1+y"%=1+ tan’? p= sec’ f, 
12\3 | 
(1 +y”) =| sec? p|= Tase 

therefore 


"_ l ; 
Y= Ry cos*@] (3) 


Now putting into (1) the expressions obtained for y and y”, we 
have 


l 
Riosg] ZI y, tang) 
or 


l 
R= | cos®@ |-f (x, y, tang) (4) 


It is thus evident that a second-order differential equation deter- 
mines the magnitude of the radius of curvature of an integral 
curve if the coordinates of the point and the direction of the 
tangent to this point are specified. 

From the foregoing there follows a method of approximate con- 
struction of an integral curve by means of a smooth curve com- 
posed of arcs of circles. ** 

To illustrate, let it be required to find the solution of equation 
(1) that satisfies the following initial conditions: 


Yror,= Yor Yrax, = Yo 


Through the point Me (Xə Yə) draw a ray M,T, with slope 
y' =tang,=y, (Fig. 23). From equation (4) we find the value 
R=R,. Lay off a -segment M,C,, equal to R, perpendicular 
to M,T,, and from the point C, (as centre) strike an arc M,M, 


* Up till now we have always considered the radius of curvature positive; 
in this section we shall consider it a number that. can take on both positive 
and negative values: if the curve is convex (y” <0), we consider the radius 
of saa negative (R <0); if the curve is concave (y” > 0), it is positive 

> 0). 

** A curve is called smooth if it has tangents at all points and the angle of 
inclination of the tangent is a continuous function of the arc length s. 


9 
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with radius R,. It should be noted that if R,< 0, then the seg- 
ment M,C, must be drawn in that direction so that the arc of 
the circle is convex upwards, and for R,>0, convex down (see 
footnote on page 67). 

Then let x,, y, be the coordinates of the point M, which lies 
on the constructed arc and is sufficiently close to the point M, 
while tan @, is the slope of the tan- 
gent M,T, to the circle drawn at M,. 
From equation (4) we find the value 
R=R, that corresponds to M,. Draw 
the segment M,C,, perpendicular to 
M,T,, equal to R,, and from C, (as 
centre) strike an arc M,M, with ra- 
dius R,. Then on this arc take a point 
M, (x2, Y4) close to M, and continue 
construction as before until we get 
a sufficiently large piece of the curve 

Fig. 23 consisting of the arcs of circles. From 

i the foregoing it is clear that this curve 

is approximately an integral curve that 

passes through the point M,. Obviously, the smaller the arcs 

M,M,, M,M,, ..., the closer the constructed curve will be to 
the integral curve. 


1.20 HOMOGENEOUS LINEAR EQUATIONS. 
DEFINITIONS AND GENERAL PROPERTIES 


Definition 1. An nth-order differential equation is called linear 
if it is of the first degree in the unknown function y and its 
derivatives y’, ..., y*-”, y'”; that is, if it is of the form 


ayy ayd... any =F (x) () 


where a, A Qa» ..., a, and f(x) are given functions of x or 
constants, and a,=40 for all values of x in the domain in which 
we consider equation (1). From now on we shall presume that the 
functions a,, a,, ..., @, and f(x) are continuous for all values 
of x and that the coefficient a,=1 (if it is not equal to | we 
can divide all terms of the equation by it). The function f(x) on 
the right side of the equation is called the right-hand member of 
the equation. 

If F(x) #0, then the equation is called a nonhomogeneous linear 
equation. But if f(x)=0, then the equation has the form 


y + ay +... + a,y=0 (2) 
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and is called a homogeneous linear equation (the left side of this 
equation is a homogeneous function of, the first degree in y, y’, 
K. (2) 
Let us determine some of the basic properties of homogeneous 
linear equations, confining our proof to second-order equations. 
Theorem 1. /f y, and y, are two particular solutions of a homo- 
geneous linear equation of the second order 


y" + ay’ +ay=0 (3) 


then y,+y, is also a solution of this equation. 
Proof. Since y, and y, are solutions of the equation, we have 


yi tay, + ay, =0 
and (4) 


Ya + aY: + Ay, =0 


Putting into equation (3) the sum y,-++y, and taking into account 
the identities (4), we will have 


(Yr + Ya)" +a, (Ys + Ye)’ + Oe Ys + Ye) 
= (Yi F ay; + ay) + (ys +ayY, + AY) =0+0=-0 


Thus, y,-+y, is a solution of the equation. 

Theorem 2. /f y, is a solution of equation (3) and C is a con- 
stant, then Cy, is also a solution of (3). 

Proof. Substituting into (3) the expression Cy,, we get 


(Cy,)" +a, (Cy,)’ +a (Cy,) =C [yi +0,9; +a,y,] =C-0=0 


and the theorein is thus proved. 

Definition 2. The two solutions of equation (3), y, and y,, are 
called linearly independent_on an interval [a, b] if their ratio on 
this interval is not a constant; that is, if 


kki Æ const 
Yz 


Otherwise the solutions are called linearly dependent. In other 
words, two solutions, y, and y,, are called linearly dependent on 
an interval [a, b] if there exists a constant number A such that 
mah when axx <b. In this case, y,=Ay,. 
2 

Example 1. Let there be an equation y”—y-==-0. It is easy to verify that the 
functions e*, e~*, 3e*%, 5e-* are solutions of this equation. Here, the functions e* 
and e-* are linearly independent on any interval because the ratio aes 


does not remain constant as x varies. But the functions e* and 3e* are linearly 


dependent, since Bet cg cbs 
p , oe : 
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Definition 3. If y, and y, are functions of x, the determinant 


Yı Y2 
Yi Yr 
is called the Wronskian of the given functions. 


Theorem 3. /f the functions y, and y, are linearly dependent on 
an interval [a, b], then the Wronskian on this interval is identi- 
cally zero. 

Indeed, if y,=Ay, where A= const, then y,;=Ay, and 


Ys Ya] _ 41 wd aa Y n|=o0 
Yı Ye Yı Yı 


W (Y, 92) = = YY — YY: 


wW l ’ — , ’ 
(Yis Ys) ae 
Theorem 4. If the Wronskian W (y,, y,), formed for the solutions 
y, and y, of the homogeneous linear equation (3), is not zero for 
some value x==Xx, on an interval [a, b] where the coefficients of the 
equation are continuous, then it does not vanish for any value of x 
whatsoever on that interval. 
Proof. Since y, and y, are two solutions of equation (3), we 
have 
Y, + ay, -Fazy =0 
yi tay, +ay,=0 
Multiplying the terms of the first equation by y,, the terms of 
the second equation by y, and subtracting the latter from the 
former, we get 


(Y1Y2—YiY2) +0, (Y142—YiY2) = 0 (5) 
The difference in the second parenthesis is the Wronskian 


W (y,, Y), namely, W (Y,, Yo) = (Y,Y2—Y1Y:). The difference in the 
first parenthesis is the derivative of the Wronskian: 


Wi Ys» Ya) = (YiY2—YiYa)’ = YY — YY 
He ice, equation (5) takes the form 
W’+a,W =0 (6) 
L_t us find the solution to the last equation that satisfies the 


initial condition W|,.,.=W,. We first find the general solution 
to equation (6) on the assumption that W 0. Separating variab- 


les in (6), we get T =—a, de. 
Integrating we find 


x 
InW =—la,dx+InC 
Xo 
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or 


whence 


W=Ce * (7) 


It will be noted that we can write the function (7) and say 
that this function satisfies equation (6), which is clear if we sub- 
stitute this function directly into (6). The assumption W 0 is 
not required. 

Formula (7) is called Liouville’s formula. 

We define C so that the initial condition is satisfied. Substitut- 
ing x==x, into the left and right sides of (7), we get 


W,=C 


Consequently, the solution that satisfies the initial conditions 
takes the form 
x 


-{ a,dx 


W=-Wee * (7’) 


By hypothesis, W,40. But then from (7’) it follows that W20 
for any value of x, because the exponential function does not va- 
nish for any finite value of the argument. The proof is complete. 

Note 1. If the Wronskian is zero for some value x =x, then 
it is also zerofor any value x in the interval under consideration. 
This follows directly from (7): if W =0 when x= x, then 


(W ens, =C=0 


consequently, W=0, no matter what the value of the upper limit 
of x in formula (7). 

Theorem 5. If the solutions y, and y, of equation (3) are linear- 
ly independent on an interval [a, b], then the Wronskian W, 
formed for these solutions, does not vanish at any point of the given 
interval. 

Proof. To start with, note the following. The function y =0 is 
a solution of equation (3) on the interval [a, b] that satisfies the 
initial conditions 


Yx=x =Q, Yeux, = 0 


where x, is any point in the interval [a, b]. From the existence 
and uniqueness theorem (see Sec. 1.16), which is applicable to 
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equation (3), it follows that there is no other solution to equa- 
tion (3) that satisfies the initial conditions 


Yr=x =Q, Yrer 20 


From this same theorem, it also follows that if the solution to 
equation (3) is identically zero on some closed interval or the 
open interval (a, B) belonging to the interval [a, b], then this 
solution is identically zero over the whole interval [a, b]. Indeed, 
at the point x= f (and at the point x=-a) the solution satisfies 
the initial conditions 

Yx=p =0, Yre = 0 


Hence, by the uniqueness theorem, it is also zero on some inter- 
val B—d<x<fi+d, where d is determined by the coefficients 
of equation (3). Thus, extending the interval each time by the 
amount d, where y =0, we can prove that y= 0 over the entire 
interval [a, b]. 

Let us now begin the proof of Theorem 5. Assume that 
W (y,, Y) =0 at some point of the interval [a, b]. Then, by Theo- 
rem 3, the Wronskian W (y,, y,) will be zero at all points of 
[a, b]: , 

W=0 or Y, Y2 — YY = 0 


Suppose that y, = 0 on the interval [a, b]. Then, by the last 
equation, we can write 


Hya HY o or (2) =0 
PH 41 


whence it follows that 
Yt =} = const 
Yı 


that is, the solutions y, and y, are linearly dependent, which runs 
counter to the assumption that they are linearly independent. 

Suppose, furthermore, that y,=0 at the points x,, Xa} ..., 
in [a, b]. We consider the interval (a, x,). On this interval, gine” 
Hence, by what has just been proved, it follows that on ‘the in- 
terval (a, x,) 


i: =A= const o Y= 


We consider the function y=y,—?y,. Since y, and y, are solu- 
tions of equation (3), then y=-y,—Ay, is a solution of (3) and 
y= 0 over the interval (a, x,). Thus, by the remark made at the 
beginning of the proof it follows that Y == Y,— Ay, =0 on the in- 
terval [a, b] or 

Ye 4 

Yı 
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on the interval [a, 6], which is to say y, and y, are linearly 
dependent. - 

But this contradicts the assumption that the solutions y, and 
y, are linearly independent. We have thus proved that the Wrons- 
kian does not vanish at any point of the interval [a, b]. 

Theorem 6. /f y, and y, are two linearly independent solutions 


of equation (3), then 
y = Ciy, + CY: (8) 


where C, and C, are arbitrary constants, is its general solution. 
Proof. From Theorems 1 and 2 it follows that the function 


CY, + Coy, 


is a solution of equation (3) for any values of C, and C,. 

We shall now prove that no matter what the initial conditions 
Yx=x “2 Yo: Yk=x == Yo, it is possible to choose the values of the ar- 
bitrary constants C, and C, so that the corresponding particular 
solution C,y,+C.y, should satisfy the given initial conditions. 

Substituting the initial conditions into (8), we have 


Jo = Cito + CY \ 


; Aa , 9 
Yo = CY + Cryo J 9) 
where we put 
(Yi)x=xo == Yi (Yaran =Y (Yi)x=xy =Y  (Ya)x=xy = Yoo 
From system (9) we can determine C, and C,, since the determi- 
nant of this system 


Yio Y0 
oe Yio Yr 


is the Wronskian for x= x, and, hence, is not equal to O (by vir- 
tue of the linear independence of the solutions y, and y,). The 
particular solution obtained from the family (8) for the found 
values of C, and C, satisfies the given initial conditions. Thus, 
the theorem is proved. 


Example 2. The equation 


, r 
= Yr Yay Y nY 


n 1 r ! nae 
yry p= 


í l 1 ; . 
whose coefficients a= a and dg==— — are continuous on any interval that 


docs not contain the point x==0, admits the particular solutions 


l 
n= h= 


(this is readily verified by substitution). Hence, its general solution is of the 
form 


l 
y= +07 
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Note 2. There are no general methods for finding (in closed 
form) the general solution of a linear equation with variable coef- 
ficients. However, such a method exists for an equation with 
constant coefficients. It will be given in the next section. For the 
case of equations with variable coefficients, certain devices will 
be given in Chapter 4 (Series) that will enable us to find appro- 
ximate solutions satisfying definite initial conditions. 

Here we shall prove a theorem that will enable us to find the 
general solution of a second-order differential equation with vari- 
able coefficients if one of its particular solutions is known. Since 
it is sometimes possible to find or guess one particular solution 
directly, this theorem will prove useful in many cases. 

Theorem 7. /f we know one particular solution of a second-order 
homogeneous linear equation, the finding of the general solution 
reduces to integrating the functions. 

Proof. Let y, be some known particular solution of the equation 


y" + ay’ +a,y =0 


We find another particular solution of the given equation so that 
y, and y, are linearly independent. Then the general solution will 
be expressed by the formula y-=C,y,+C,y,, where C, and C, are 
arbitrary constants. By virtue of formula (7) (see proof of Theo- 


rem 4), we can write 
- f a, dx 
YoY. — YY; = Ce 


Thus, for a determination of y, we obtain a first-order linear 
equation. Integrate it as follows. Divide all terms by y?: 


Yi — You, I aa) ara 


yi ʻi 
or 
A ar 
dx \ yı y? 
whence 


Since we are seeking a particular solution, we get (by putting 
C’ =0 and C=1) 


-\ adx 


n=n | i (10) 
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It is obvious that y, and y, are linearly independent solutions 
since z = const. : 
Thus, the general solution of the original equation is of the form 
-\ a,dx 


y=Cy,+Cuy, |! y? dx (11) 


Example 3. Find the general solution of the equation 
(1 — x?) y” —2xy' + 2y =0 
Solution. It is evident, by direct verification, that this equation has a par- 
ticular solution y, =x. Let us find a second particular solution yo, so that yı 
and y> should be linearly independent. 
= , we have, by (10), 


1— x 


Noting that in our case a = 


ea 

1-x? -In | xt} 

e e dx 
s= po de=x |a irr | 
oP. A l 1 2 1 1l, tite 
=x( (+ aty star)"= |7 xt" |I 


Consequently, the general solution is of the form 
F 1) 


y=Cx+C,( -7 xIn | te 
1.21 SECOND-ORDER HOMOGENEOUS LINEAR 
EQUATIONS WITH CONSTANT COEFFICIENTS 


| 


We have a second-order homogeneous linear equation 
y"+ py’ +qy =0 (1) 


where p and q are real constants. To find the complete integral 
of this equation, it is sufficient (as has already been proved) to 
find two linearly independent particular solutions. 

Let us look for the particular solutions in the form 


y = ek, where k = const (2) 
then 
y’ =ke**, y” = k*ek* 


Substituting the expressions of the derivatives into equation (1), 
we find 
ekx (k? + pk +q) =0 
Since e** £0, this means that 
k + pk+q=0 (3) 
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Thus, if k satisfies equation (3), then e** will be a solution 
of (1). Equation (3) is called an auxiliary equation with respect 
to equation (1). 

The auxiliary equation is a quadratic equation with two roots; 
let us denote them by &, and &,. Then 


2 Da T 
ee a ee oe 


The following cases are possible: 
I. k, and k, are real numbers and not equal (k, ~&,), 
II. k, and k, are complex numbers, 
II. k, and k, are real and equal numbers (k, = &,). 
Let us consider each case separately. 
I. The roots of the auxiliary equation are real and distinct, 
k,k,. Here, the particular solutions are the functions 


Y, =e, yy = eb 
These solutions are linearly independent because 
ne 


= elk ki) X —% const 


Hence, the complete integral has the form 
y == Cyek* + C,efa* 
Example 1. Given the equation 


y"--y’—2y=0 
The auxiliary equation is of the form 
k+k—2=0 


We find the roots of the auxiliary equation: 
l l 
kie=— 7 + yit 
k=l, k =—2 
The complete integral is 
y =Cye*¥ + Cye-2* 
Il. The roots of the auxiliary equation are complex. Since com- 
plex roots are conjugate in pairs, we write 


k,=a+ip, k&,=a—ifp 


where 
__ P z P 
a=—4, B=V 4-5 
The particular solutions may be written in the form 
Yı = el% +B) x. 2 = e(a— iB) x (4) 


These are complex functions of a real argument that satisfy the 
differential equation (1) (see Sec. 7.4, Vol. I). 
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It is obvious that if some complex function of a real argument 
y =u (x) + iv (x) ° (5) 
satisfies (1), then this equation is satisfied by the functions u (x) 
and v(x). 
Indeed, putting expression (5) into (1), we have 
[u (x) + iv (x)]" + p [u (x) + iv (x)]’ + q [u (x) + iv (x)] = 0 
or 
(u" + pu’ + qu) + i (v" + po’ + qv) =0 
But a complex function is equal to zero if, and only if, the real 
part and the imaginary part are equal to zero; that is, 
u" + pu’ + qu=0 
v" + po’ +qu=0 
Thus we have proved that w(x) and v(x) are solutions of the 
equation. 


Let us rewrite the complex solutions (4) in the form of a sum 
of the real part and the imaginary part: 


Y, = e% cos Bx + ie sin Bx 
Y, = e@* cos Bx — ie% sin Bx 


From what has been proved, the particular solutions of (1) are 
the real functions 5 


yY, = e2* cos Bx (6°) 
Y, =e% sin Bx (6°) 
The functions y, and y, are linearly independent, since 
m s3 
2 = seak a = cot Bx + const 
2 


Consequently, the general solution of equation (1) in the case of 
complex roots of the auxiliary equation is of the form 


y= Cy, + Coy, =: Ce cos Bx + C,e** sin Bx 
or 
y = e**(C, cos Bx + C, sin Bx) (7) 
where C, and C, are arbitrary constants. 
An important particular case of the solution (7) is the case 


where the roots of the auxiliary equation are pure imaginary. 
This occurs when p=0 in equation (1) and it has the form 


y+ qy=0 
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The auxiliary equation (3) assumes the form 
Re q=0, q> 0 
The roots of the auxiliary equation are 
ki2=+iVq=+ifp, a=0 
The solution (7) becomes 
y = C, cos Bx -+ C, sin Bx 
Example 2. Given the equation 
y" +2y' -+ 5y=0 


Find the complete integral and a particular solution that satisfies the initial 
conditions y x=o=0, Y'x-o= 1. Construct the graph. 
Solution. (1) We write the auxiliary equation 


k?+2k+5=0 
ky=—142i, k=—1l—2i 
Thus, the complete integral is 
y=e-* (C, cos 2x-+C, sin 2x) 
(2) We find a particular solution that satisfies the given initial conditions 


and determine the corresponding values of C, and C}. 
From the first condition we find 


0=e-° (C, cos 2-04 C sin 2:0), whence C,=0 


and find its roots: 


Noting that 
y’ =e-* 2C, cos 2x —e-* C, sin 2x 


we obtain from the second condition 


I=, ie, C= 


Thus, the desired particular solution is 


1 
——er* sj 
y=5e sin 2x 


Its graph is shown in Fig. 24. 
Example 3. Given the equation 
y”+9y=0 
Taa ne general solution and a particular solution satisfying the initial con- 
i 
Yx=0=0, Y'x=0=3 
Solution. Write the auxiliary equation 
k? +9=0 
We find its roots to be 
k, =3i, ko = —3i 
The general solution is 
y =C; cos 3x-+C, sin 3x 
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Let us find a particular solution. First we find 
y’ = — 3C, sin 3x -+3C, gps 3x 
The constants C, and C, are defined from the initial conditions 
0=C, cos 0+C, sin 0 
3=— 3C, sin0+3C, cos 0 


C,=0, C,=1 


They are 


The particular solution is 
y = sin 3x 


Fig. 24 
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II. The roots of the auxiliary equation are real and equal. Here, 


hy = hy. 


One particular solution, y, = e**, is obtained from earlier reason- 
ing. We must find a second particular solution, which is linearly 
independent of the first (the function e*:* js identically equal to 
ekx and therefore cannot be regarded as a second particular solu- 


tion). 


We shall seek the second particular solution in the form 


Yo = u (x) ef 


where u(x) is the unknown function to be determined. 
Differentiating, we find 


Y, ze u'ef:* + k,ueks* = eksx (u’ + kyu) 


y, == u"eks* + 2k u'et* + Reueki* = eti* (u” + 2k u’ + ku) 
Putting the expressions of the derivatives into (1), we obtain 


erix [u" + (2k, + p) u’ + (2 + pk, +9) u] =0 


Since k, is a multiple root of the auxiliary equation, we have 


ki+ pk, +q=0 
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The auxiliary equation (3) assumes the form 
4g =0, q> 0 
The roots of the auxiliary equation are 
kie=tiVg=+if, a=0 
The solution (7) becomes 
y = C, cos Bx -+ C, sin Bx 
Example 2. Given the equation 
y” +2y' -5y =0 
Find the complete integral and a particular solution that satisfies the initial 


conditions yx=o=0, y’x.9=1. Construct the graph. 
Solution. (1) We write the auxiliary equation 
k?+2k+5=0 


and find its roots: 
kı=—l+2i, k,=—1—2i 
Thus, the complete integral is 
y =e- * (C, cos 2x +C, sin 2x) 
(2) We find a particular solution that satisfies the given initial conditions 


and determine the corresponding values of C, and C}. 
From the first condition we find 


0=e-° (C, cos 2-:0+C, sin 2.0), whence C,=0 
Noting that 
y’ =e-* 2C, cos 2x —e-* C, sin 2x 
we obtain from the second condition 
1=2C,, i.e, C= 
Thus, the desired particular solution is 
l : 
y=5e * sin 2x 


Its graph is shown in Fig. 24. 
Example 3. Given the equation 
y’+9y=0 
nd the general solution and a particular solution satisfying the initial con- 
itions 
Yx=0=0,  Y'x=0=3 
Solution. Write the auxiliary equation 
k?+9=0 
We find its roots to be 
k,=3i, k = —3i 
The general solution is 
y =C; cos 3x+C, sin 3x 
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Let us find a particular solution. First we find 
y’ =— 3C, sin 3x -+3C, gps 3x 
The constants C, and C, are defined from the initial conditions 
0=C,cos0+C, sin 0 
3 = — 3C, sin 0+ 3C, cos 0 


C,=0, C,=1 


They are 


The particular solution is 
y=sin 3x 


Seuss y=fersinde 


~ 


— _— m 1l 


Fig. 24 


II. The roots of the auxiliary equation are real and equal. Here, 
ki =k,. 

"One particular solution, y, =e*:*, is obtained from earlier reason- 
ing. We must find a second particular solution, which is linearly 
independent of the first (the function e:* is identically equal to 
ekx and therefore cannot be regarded as a second particular solu- 
tion). 

We shall seek the second particular solution in the form 
Ya = u (x) eb 
where u(x) is the unknown function to be determined. 
Differentiating, we find 
a = U'eti* + k ueti* = esx (u' + ku) _ 

y, == "est + 2k u'eki* + kłueki* = eki* (u” + 2k u’ + k?u) 
Putting the expressions of the derivatives into (1), we obtain 
erix [u" + (2k, + p) u’ + (k?+ pk, +9) u] =0 

Since k, is a multiple root of the auxiliary equation, we have 


ki+ pk, +q=0 
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Besides, k =k, =—5 or 2k, = — p, 2k, +p=-0. 

Hence, in order to find u(x) we must solve the equation 
ektu" = 0 or u” =0. Integrating, we get u= Ax+- B. In particular, 
we can set A= 1 and B= 0; then 

u=x 
Thus, for the second particular solution we can take 
Y, = xe 


This solution is linearly independent of the first, since i x # const. 
p z ‘ 1 
Therefore, the following function is the general solution: 
y = Cei” + Cxe = eři* (C, + C,x) 
Example 4. Given the equation 
y” —4y’ +-4y=0 
Write the auxiliary equation k2—4k+4-=0. Find its roots: ky=k,=2. 
The complete integral is then 
y = Cye2* + Cyxe?* 


1.22 HOMOGENEOUS LINEAR EQUATIONS OF THE NTH ORDER WITH 
CONSTANT COEFFICIENTS 


Let us consider a homogeneous linear equation of the nth order: 
y+ ayy?-P +... +a,y=0 (1) 


We shall assume that a,, a,, ..., a, are constants. Before giving 
a method for solving equation (1), we introduce a definition that 
will be needed later on. 
Definition 1. If for all x of the interval [a, 6] we have the 
equality 
Pn (x) = A,Q, (x) + AP (x) + seek A,-1Pn-1 (x) 


where A,, A,, ..., A, are constants, not all equal to zero, then we 
say that ,(x) is expressed linearly in terms of the functions 
Pı (x), P: (x), CEER Pn-1 (x). i 

Definition 2. n functions 9, (x), a(x), -.-, Pa-1 (x), Pa (x) are 
called linearly independent if not one of the functions is expressed 
linearly in terms of the rest. 

Note 1. From the definitions it follows that if the functions 
9, (x), P(x), ---, a(x) are linearly dependent, there will be con- 
stants C,, C,, ..., C,, not all zeroes, such that for all x in the 
interval [a, b] the following identity will hold true: 


Cif, (x) + Capa (x) -H +- + CP, (x) = 0 
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Examples: 
1. The functions y; =€*, yg=e9*, yy==3e* are linearly dependent, since for 
C,=1, C,=0, C;=—— we have the identity 


3 
Cye* + Cae? + Cy3e* Zo 
2. The functions y,=1!, y,=x, y3=x? are linearly independent, since the 
expression 
Cyl + Cx + C 3x? 
will not be identically zero for any C,, Cz, C3 that are not simultaneously 


equal to zero. 


3. The functions y,=e"*, yo=e***, ..., y, =e*n*, ..., where ky ghana ed 
are merce numbers, are linearly fidenendent: (This assertion is given without 
proof.) 


Let us now solve equation (1). For this equation, the following 
theorem holds. 

Theorem. /f the functions y,, Y., --., Y, are linearly independent 
solutions of equation (1), then its general solution is 


Y =C HCY +... +04, (2) 


where Ci, ..., C, are arbitrary constants. 

If the coefficients of equation (1) are constant, the general so- 
lution is found in the same way as in the case of second-order 
equations. 

(1) Form the auxiliary equation 


k" +a,k"-! +a,k"-? + Sate +a, = 0. 
(2) Find the roots of the auxiliary equation 
Rioc Ria See Ry 


(3) From the character of the roots write out the particular 
linearly independent solutions, taking note of the fact that: 

(a) to every real root k of order one there corresponds a parti- 
cular solution e**; 

(b) to every pair of complex conjugate roots k®=a@+ iB and 
k® —a—if there correspond two particular solutions e@*cos hx. 
and e% sin Bx; 

(c) to every real root k of multiplicity z there correspond r 
linearly independent particular solutions 


ekx, xekx, ..., xi ~lekx- 


(d) to each pair of complex conjugate roots k=-a-+if, 
k® =a—if of multiplicity u there correspond 2p particular so- 
lutions: 


e**cosBx, xe**cosBx, ..., x¥-2e%* cos Bx, 
ex sin Bx, xe™*sinBx, ..., x#- leox sin Bx 
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The number of these particular solutions is exactly equal to the 
degree of the auxiliary equation (that is, to the order of the given 
linear differential equation). It may be proved that these solutions 
are linearly independent. 

(4) After finding n linearly independent particular solutions 


Yis Yor »»+, Y, We construct the general solution of the given 
linear equation: 

Y=Cyy+Crt+--- + Cin 
where Ci, Ca, ..., Cna are arbitrary constants. 


Example 4. Find the general solution of the equation 
y'Y—y=0 
Solution. Form the auxiliary equation 
kt#—1=0 
Find the roots of the auxiliary equation: 
ki=1, ko=—1, kg=i, kg=—i 
Write the complete integral 
y=Cye* +Ce7* +C; cos x+C, sin x 
where C,, Cz, Cs, C, are arbitrary constants. 
Note 2. From the foregoing it follows that the whole difficulty 


in solving homogeneous linear differential equations with constant 
coefficients lies in the solution of the auxiliary equation. 


1.23 NONHOMOGENEOUS SECOND-ORDER LINEAR EQUATIONS 


Let there be a nonhomogeneous second-order linear equation 
y" + ay’ + ay =f (x) (1) 
The structure of the general solution of such an equation is 
determined by the following theorem. 
Theorem 1. The general solution of the nonhomogeneous equation 
(1) is represented as the sum of some particular solution of the 


equation y* and the general solution y of the corresponding homo- 
geneous equation 


y+ ay’ +4,y=0 (2) 
Proof. We need to prove that the sum 
y=y+y" (3) 


is the general solution of equation (1). Let us first prove that the 
function (3) is a solution of (1). 
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Substituting the sum y+y* into (1) in place of y, we get 
U+ +a YH +a y+ =F (x) 
or 
("+ ay’ + asy) + (y*" + ay" +a,y*) = f (x) (4) 


Since y is a solution of (2), the expression in the first brackets 
is identically zero. Since y* is a solution of (1), the expression 
in the second brackets is equal to f(x). Consequently, (4) is an 
identity. Thus, the first part of the theorem is proved. 

We shall now prove that expression (3) is the general solution 
of equation (1); in other words, we shall prove that the arbitrary 
constants that enter into the expression may be chosen so that 
the following initial conditions are satisfied: 


Yx=x. = Yo \ 
: 5 
Yx=x, = Yo J (65) 
no matter what the numbers x,, y, and yọ [provided that x, is 


taken from the region where the functions a,, a, and f(x) are 
continuous]. 


Noting that y may be given in the form 
y = CY + CY: 


where y, and y, are linearly independent solutions of equation (2), 
and C, and C, are arbitrary constants, we can rewrite (3) in the 
form 


y =C +CH + Y" (3°) 
Then, by the conditions (5), we will have * 


CY + CoY20 + Yo = Yo 
Cio HCY +Y = Ys 
From this system of equations we have to determine C, and C,. 
Rewriting the system in the form 
Cito + Cate = Yo— Yo \ (6) 
Cio +CoY20= Yo— Yo J 
we note that the determinant of this system is the Wronskian 
for the functions y, and y, at the point x= x,. Since it is given 


that these functions are linearly independent, the Wronskian is 
not zero; consequently, system (6) has a definite solution, C, 


* Here, Yio, Yao. Yo, Yio, Yoo, ye denote the numerical values of the func- 
tions 41, Ys, Y*, Y, Yz, y* when x=Xq. 
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and C,; in other words, there exist values C, and C, such that 
formula (3) defines the solution of equation (1) which satisfies 
the given initial conditions. The theorem is completely proved. 

Thus, if we know the general solution y of the homogeneous 
equation (2), the basic difficulty, when integrating the nonhomo- 
geneous equation (1), lies in finding some particular solution y*. 

We shall give a general method for finding the particular so- 
lutions of a nonhomogeneous equation. 

The method of variation of arbitrary constants (parameters). 
We write the general solution of the homogeneous equation (2): 


y= Cy, + Cy, (7) 


We shall seek a particular solution of the nonhomogeneous 
equation (1) in the form (7), considering C, and C, as some (as 
yet) undetermined functions of x. 

Differentiate (7): 


y’ = Cy, + Caya + Cy + Cope 
Now choose the needed functions C, and C, so that the following 


equation holds: 

Ci + Cis =0 (8) 
If we take note of this additional condition, the first derivative y’ 
will take the form 

y = CY; + Coys 
Differentiating this expression, we find y”: 

y" = Ciy; + Coys + Crys + Coys 
Putting y, y’ and y” into (1), we get 
Cy + Coy, + Cry + Coys + ay (Cit + Coys) + a2 (Cath + Coys) = F (x) 
or 
Cy (Yi + 0Y + os) + Ce (Y3 + 01y + O42) + Cy, -+ Coys = F (x) 


The expressions in the first two brackets vanish, since y, and y, 
are solutions of the homogeneous equation. Hence, the latter equa- 
tion takes on the form 


Ciy: + Coys = F(x) (9) 
Thus, the function (7) will be a solution of the nonhomogeneous 
equation (1) provided the functions C, and C, satisfy the system 
of equations (8) and (9); that is, if 
Ciy +C =0, Ciit Coys = F(x) 
Since the determinant of this system is the Wronskian for the 
linearly independent solutions y, and y, of equation (2), it is not 


1.23 Nonhomogeneous Second-Order Linear Equations 85 


equal to zero. Hence, in solving the system we will find C; and C; 
as definite functions of x: 
Ci=9. (x), Cr= 2 (x) 
Integrating, we obtain 


Cr=foilxdx+C,,  C,= | p. (x) dx+C, 


where C, and C, are constants of integration. 

Substituting the expressions obtained for C, and C, into (7), 
we find an integral that is dependent on the two arbitrary con- 
stants C, and C,; that is, we find the general solution of the 
nonhomogeneous equation. * 

Example. Find the general solution of the equation 


a l 
y AL =x 


Solution. Let us find the general solution of the homogeneous equation 
y 


el 


x 


e 


Since 
we have In y’=Inx+InC, y'=Cx 


and so 
y=Ci2+C, 


For the latter expression to be a solution of the given equation, we have 
to define C, and C} as functions of x from the system 


CyxP+Cy-1=0, 2Cix+ C: 0=x 
Solving this system, we find 


whence, after integration, we get 
m s = 
GQ=54+G, C=—% +0, 


Putting the functions obtained into the formula y=C,x?+C,, we get the 
general solution of the nonhomogeneous equation: 


= =z 5 x 
y= ++ 


or g = Cx? +03 42 , where C, and C, are arbitrary constants. 


When seeking particular solutions, it is useful to take advan- 
tage of the results of the following theorem. 


* If we put C= C,=0, we get a particular solution of equation (1). 
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Theorem 2. The solution y* of the equation 
y" tay’ + ay = fi (x) + fa (x) (10) 


where the right member is a sum of two functions f,(x) and f, (x), * 
may be represented as the sum y*=yi-+-y3, where yi and y; are, 
respectively, the solutions of the equations 


or +a Yi +a = f, (x) (11) 
Y? + aY: +442 = fa (x) (12) 
Proof. Adding the right and left members of (11) and (12), we 
get 
(yi +92)" +a (YI ty Hal +92) =f (x) +ha(x) 3) 
From this equation it follows that the sum 
Yi ty =y 
is a solution of equation (10). 
Example. Find the particular solution y* of the equation 
y” —4y =x 43e 
Solution. The particular solution to the equation 
yi +4 =x 
._ 1 
n=7* 
The particular solution to the equation 
ye +4y2 =3e* 


yi=s ex 


5 


The particular solution y* of this equation is 
l 3 
ak a DA 
agit se 
1.24 NONHOMOGENEOUS SECOND-ORDER LINEAR 


EQUATIONS WITH CONSTANT COEFFICIENTS 


Suppose we have the equation 
y" + py’ + qy =F (x) (1) 
where p and q are real numbers. 


* It is clear that the theorem holds true for'any number of terms in the 
right member of the equation. 
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A general method for finding the solution of a nonhomogeneous 
equation was given in the preceding section. In the case of an 
equation with constant coefficients, it is sometimes easier to find 
a particular solution without resorting to integration. Let us consi- 
der several such possibilities for equation (1). 

I. Let the right side of (1) be the product of an exponential 
function by a polynomial; that is, of the form 


f(x) = Pa (x)e* (2) 


where P,,(x) is a polynomial of degree n. Then the following par- 
ticular cases are possible: 
(a) The number @ is not a root of the auxiliary equation 


k + pk+q=0 


In this case, the particular solution must be sought for in the 
form 


y* = (Ax + Ayx"-3 +... + An) e* = Q, (x) e (3) 


Indeed, substituting y* into equation (1) and cancelling e™ out 
of all terms, we will have 


Qa (x) + (2a + p) Qn (x) + (2° + pa + q) Qn (x) = P, (x) (4) 


Q,,(x) is a polynomial of degree n, Q(x) is a polynomial of de- 
gree n—1l, and Q(x) is a polynomial of degree n—2. Thus, 
n-degree polynomials are found on the left and right of the equa- 
lity sign. Equating the coefficients of the same degrees of x (the 
number of unknown coefficients is n+ 1), we get a system of n+1 
equations for determining the unknown coefficients A, A,, 


eng Ane 

(b) The number æ is a simple (single) root of the auxiliary equa- 
tion. 

If in this case we should seek the particular solution in the 
form (3), then on the left side of (4) we would have a polyno- 
mial of degree n—1, since the coefficient of Q, (x), that is,a?+ pa+tg, 
is equal to zero, and the polynomials Q,(x) and Q} (x) have deg- 
rees less than n. Hence, (4) would not be an identity, no matter 
what A» As» --., An. For this reason, the particular solution 
in this case has to be taken in the form of a polynomial of degree 
n+1, but without the absolute term (since the absolute term of 
this polynomial vanishes upon differentiation): * 


y* = xQ,, (x)e™ 


* We remark that all the results given above also hold for the case where a 
is a complex number (this follows from the rules for differentiating the func- 
tion e**, where m is any complex number; see Sec. 7.4, Vol. I). 
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(c) The number @ is a double root of the auxiliary equation. 
Then, as a result of the substitution of the function Q, (x)e* into 
the differential equation, the degree of the polynomial is diminished 
by two units. Indeed, if æ is a root of the auxiliary equation, 
then a?-+ pa+q=0; moreover, since æ is a double root, it follows 
that 2a = —p (since by a familiar theorem of elementary algebra, 
the sum of the roots of a reduced quadratic equation is equal to 
the coefficient of the unknown to the first power with sign rever- 
sed). And so 2a+p=0. 

Consequently, on the left side of (4) there remains Q; (x), that 
is, a polynomial of degree n—2. To obtain a polynomial of deg- 
ree n as a result of substitution, one should seek the particular 
solution in the form of a product of e% by the (n+ 2)th degree 
polynomial. Then the absolute term of this polynomial and the 
first-degree term will vanish upon differentiation; for this reason, 
they need not be included in the particular solution. 

Thus, when @ is a double root of the auxiliary equation, the 
particular solution may be taken in the form 


y® = x°Q,, (x) e* 
Example 1. Find the general solution of the equation 
y” +4y' +3y=x 
Solution. The general solution of the corresponding homogeneous equation is 
y =Cye-* + Coe-3* 


Since the right-hand side of the given nonhomogeneous equation is of the 
form xe* [that is, of the form P, (x) e*], and O is not a root of the auxiliary 
equation kè + de 3— 0, it follows that we should seek the particular solution 
in the form y*=Q, (x) e0x; in other words, we put 


y* = Agx+ A, 
Substituting this expression into the given equation, we will have 
4Ao +3 (Ax +A) =x 
Equating the coefficients of identical powers of x, we get 


3A =l, 4A +341 = 
whence 


Consequently, 


The general solution of y=y+y* will be 


y=Cen* Ce pot 
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Example 2. Find the general solution of the equation 
y” +9y = (x#+ 1) e* 
Solution. The general solution of the homogen®ous equation is readily found: 
y =C; cos 3x+ Ca sin 3x 
The right side of the given equation (x24 1)e°* has the form 
P, (x) e8* 

Since the coefficient 3 in the exponent is not a root of the auxiliary equa- 

tion, we seek the particular solution in the form 
y* = Qa (x) Èx or y* = (Ax? + Bx-+C) e% 

Substituting this expression in the differential equation, we have 

[9 (Ax? + Bx 4-C) +6 (2Ax + B)+ 2A +9 (Ax? + Bx+-C)] e8* = (x? +1) 8*7 


Cancelling out e°% and equating the coefficients of identical powers of x, we 
obtain 
18A=1, 12A+18B=0, 2A+6B-+-18C=1 

1 


whence yee B=-—-=, c=% 


T8’ 7 ar: Consequently the particular solution is 


and the general solution is 


; 1 1 5 
y =C; cos 3x +C; sin 3x + (B -7 x+ a) ex 
Example 3. To solve the equation 
y” —7y’ + Oy = (x—2) e* 


Solution. Here, the right side is of the form P; (x) e!* and the coefficient 1 in 
the exponent is a simple root of the auxiliary polynomial. Hence, we seek the 
particular solution in the form y* = xQ; (x) e* or 


y* = x (Ax-+-B) e* 
Putting this expression in the equation, we get 
[(Ax? + Bx) + (4Ax+ 2B) + 2A —7 (Ax? + Bx) —7 (2Ax+ B) 
+6 (Ax? + Bx)] e* = (x —2) e7 
or 
(—10Ax— 5B +-2A) e* = (x —2) ex 
Equating the coefficients of identical powers of x, we get 
—10A=1, —5B+4+2A=—2 
whence A= = ; B=2 . Consequently, the particular solution is 
1 9 
jo _ ee — 
y =*( atts) ex 

and the general solution is 


y= Cet + Coe a ( -50ta ) ex 
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II. Let the right side have the form 
f (x) = P (x) e™ cos Bx + Q (x) e* sin Bx (5) 
where P (x) and Q(x) are polynomials. 

We may handle this case by the technique used in I, if we pass 
from trigonometric functions to exponential functions. Replacing 
cosBx and sinBx by exponential functions via Euler’s formulas 
(see Sec. 7.5, Vol. I), we obtain 


Fy =P yee HEM y g (yo oe 


or 
FO = [FPO e o] eet | EP) —5 Q(x) | ele (6) 


Here, the square brackets contain polynomials whose degrees are 
equal to the highest degree of the polynomials P(x) and Q (x). 
We have thus obtained the right side of the form considered in 
Case I. 

It can be proved (we omit the proof) that it is possible to find 
particular solutions which do not contain complex numbers. 

Thus, if the right side of equation (1) is of the form 
F (x) = P (x) e“* cos Bx + Q (x) e** sin Bx (7) 
where P(x) and Q(x) are polynomials in x, then the form of the 
particular solution is determined as follows: 

(a) if the number a+ iB is not a root of the auxiliary equation, 
then the particular solution of equation (1) should be sought in 
the form 

y* = U (x) e** cos Bx +V (x) e%* sin Bx (8) 
where U (x) and V (x) are polynomials of degree equal to the highest 
degree of the polynomials P(x) and Q (x); 

(b) if the number a+if is a root of the auxiliary equation, 

we then write the particular solution in the form 


y* = x [U (x) e* cos Bx + V (x) e™ sin Bx] (9) 

Here, in order to avoid mistakes we must note that these forms 
of particular solutions, (8) and (9), are obviously retained when 
one of the polynomials P(x) and Q (x) on the right side of equa- 


tion (1) is identically zero; that is, when the right side is of the 
form 


P (x)e*cosBx or Q (x) e%*sin Bx 


Let us further consider an important special case. Let the right 
side of a second-order linear equation have the form 


f (x)= M cos px + N sin Bx (7’) 
where M and N are constants. 
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(a) If Bi is not a root of the auxiliary equation, the particular 
solution should be sought in the form 


y” = A cos px + B sin Bx (8) 


(b) If Bi is a root of the auxiliary equation, then the particular 
solution should be sought in the form 
y* =x (A cos Rx + B sin Bx) (9°) 
We remark that the function (7’) is a special case of the func- 
tion (7) [P(x)=M, Q(x)=N, a=0]; the functions (8’) and (9’) 
are special cases of the functions (8) and (9). 


Example 4. Find the general solution of the nonhomogeneous linear equa- 
tion 
y” + 2y' + 5y=2 cos x 
Solution. The auxiliary equation k?-+2k+5=0 has roots ky =—1-+2i; 
k,=—1—2i. Therefore, the general solution of the corresponding homogeneous 
equation is 
y=e-* (Cı cos 2x +C, sin 2x) 
We seek the particular solution of the nonhomogeneous equation in the form 
y*=Acosx+Bsinx 


where A and B are constant coefficients to be determined. 
Putting y* into the given equation, we have 


— A cos x— B sin x+ 2 (— A sin x+ B cos x) +5(Acosx+B sin x) =2 cos x 


Equating the coefficients of cos x and sinx, we get two equations for deter- 
mining A and B: 
—A+2B+5A=2, —B—2A+5B=0 


l 


whence A=., B =F" The general solution of the given equation is y=y+y*, 


that is, 


o| bo 


y=e-* (C, cos 2x C, sin 294+ cos spt sin x 


Example 5. Solve the equation 
y" + 4y = cos 2x 


Solution. The auxiliary equation has roots ky=2i, ka =—2i; therefore, the 
general solution of the homogeneous equation is of the form 


y =C; cos 2x+ C, sin 2x 
We seek the particular solution of the nonhomogeneous equation in the form 


y*= x (A cos 2x-+ B sin 2x) 
Then 
y* = 2x (— A sin 2x + B cos 2x)+ (A cos 2x + B sin 2x) 
y*” =—4x (— A cos 2x — B sin 2x) + 4 (— A sin 2x + B cos 2x) 
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Putting these expressions of the derivatives into the given equation and 
equating the coefficients of cos2x and sin2x, we get a system of equations 
for determining A and B: 

4B=1, —4A=0 


whence A=0 and B=. Thus, the general solution of the given equation is 


y =C; cos 2x-++-C, sin 2x44 xsin 2x 
Example 6. Solve the equation 
y” — y = 3e?* cos x 
Solution. The right side of the equation has the form 
f (x) =e* (M cos x+ N sin x) 


and M=3, N =0. The auxiliary equation k?— 1 =0 has roots k; =1, k =—1. 
The general solution of the homogeneous equation is 


y =Cye*+ Cye-* 


Since the number a-+ifp=2-+i-1 is not a root of the auxiliary equation, we 
seek the particular solution in the form 


y* = e* (A cos x+ B sin x) 
Putting this expression into the equation, we get (after collecting like terms) 
(2A + 4B) e?* cos x + (—4A + 2B) e* sin x = 3e?* cos x 
Equating the coefficients of cos x and sin x, we obtain 
2A+4B=3, —4A+2B=0 


whence a= and B=3. Consequently, the particular solution is 


y* =e & cos x+% sin x) 
and the general solution is 
3 3, 
y=Cye* + Cye-* ex (0 cos tte sinx) 
Note. All the arguments of this section hold true also for a 
linear equation of the first order. To illustrate, let us consider 


a first-order equation with constant coefficients (this equation is 
frequently encountered in engineering applications): 


Wt ay=b (10) 


where a and b are constants. We find the general solution of the 
homogeneous equation 


Form the auxiliary equation 
k+a=0, k=—a 
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The general solution of the homogeneous equation is 
y= Ce-2* 
We seek a particular solution y* of the nonhomogeneous equation 
in the form 
y=B 
Substituting into equation (10), we get 


aB=b, B=b/a 
Thus 


y* = b/a 
The general solution of (10) will then be 


y=y+y or y=Ce-*+b/a (11) 


1.25 HIGHER-ORDER NONHOMOGENEOUS LINEAR EQUATIONS 


Let us consider the equation 


y Faye? +... + any = F(x) (1) 
where 4@,, Qa ..., Qu, F(x) are continuous functions of x (or con- 
stants). 

Suppose we know the general solution 
Y=C + Cost.» + Cun (2) 
of the corresponding homogeneous equation 
y™ + ayy) ay"? faei +a,y=0 (3) 


As in the case of a second-order equation, the following asser- 
tion holds for equation (1). 

Theorem. /f y is the general solution of the homogeneous equa- 
tion (3) and y* is a particular solution of the nonhomogeneous 
equation (1), then 


Y=yty 


is the general solution of the nonhomogeneous equation. 

Thus, the problem of integrating equation (1), as in the case 
of a second-order equation, reduces to finding a particular solution 
of the nonhomogeneous equation. 

As in the case of a second-order equation, the particular solution 
of equation (1) may be found by the method of variation of para- 
meters, considering C,, Ca, ..., C, in expression (2) as functions 
of x. 
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We form the system of equations (cf. Sec. 1.23): 


Ci, + Cots +... +Cry,=90 

Cin t+ Cyat ...+Cryn=0 
bs gas dee ds At op ath Bene Mahe eee ee ata 2 (4) 
Cry? + Coys +... + Cryn? =0 
Ciy + Cay) +... + Cay? = f (x) 


This system of equations in the unknown functions Ci, Cj, ..., 
Cp has very definite solutions. (The determinant of the coef- 
ficients of Ci, C}, ..., Ca is the Wronskian formed for the parti- 
cular solutions y,, Ya, ..., y, of a homogeneous equation, and 
since these particular solutions are, by definition, linearly inde- 
pendent, the Wronskian is not zero.) 

Thus, the system (4) may be solved for the functions Cj, Cj, ..., 
Ch. Finding them and integrating, we obtain 


C,=§Cide4C,, C =f Cra +, ..., C,=$ Cadet, 


where C,, C,, ..., C, are the constants of integration. 
We shall prove that in such a case the expression 


y m Cy, +C: + Rae +C,Yn (5) 


is the general solution of the nonhomogeneous equation (1). 
Differentiate expression (5) n times, each time taking into account 
equations (4); this yields 
Y =C + C.Ys +... +CiIn 
yr =Cy, + Caa +... + Can 
POD Cy Cy F... Cyl? 
YM =Cyy + Cay +... + Cay? +f (x) 


Multiplying the terms of the first, second, ... and, finally, last 
equation by a,, an-ı» ..., Qy, and 1 respectively, and adding, 


we get 
yO Lay "D+... tay*=f (x) 


since Yı, Ys, ---,» Y, are particular solutions of the homogeneous 
equation; for this reason, the sums of the terms obtained in adding 
vertical columns are equal to zero. 

Hence, the function y*=C,y,+...+C,y, [where C,, ..., Cn 
are functions of x determined from equations (4)] is a solution of 
the nonhomogeneous equation (1), and since this solution depends 


on the n arbitrary constants C,, C}, ..., Ca, it is the general 
solution. This can be proved, as in the case of the second-order 
equation. 
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The proposition is thus proved. 

For the case of a higher-order nonhomogeneous equation with 
constant coefficients (cf. Sec. 1.24), the particular solutions are found 
more easily, namely: 

I. Let there be a function on the right side of the differential 
equation: f (x) = P (x) e%*, where P(x) is a polynomial in x; then 
we have to distinguish two cases: 

(a) if æ is not a root of the auxiliary equation, then the parti- 
cular solution may be sought in the form 

y* = Q (x) e% 
where Q (x) is a polynomial of the same degree as P(x), but with 
undetermined coefficients; 

(b) if æ is a root of multiplicity u of the auxiliary equation, 
then the particular solution of the nonhomogeneous equation may 
be sought in the form 


of = x¥ Q (x) e% 


where Q(x) is a polynomial of the same degree as P(x). 
II. Let the right side of the equation have the form 


f (x)= M cos Rx +N sin Bx 


where M and N are constants. Then the form of the particular 
solution will be determined as follows: 

(a) if the number Bi is not a root of the auxiliary equation, 
then the particular solution has the form 


y* = A cos px + B sin Bx 


where A and B are constant undetermined coefficients; 
(b) if the number fi is a root of the auxiliary equation of mul- 
tiplicity p, then 
y* = x" (A cos Bx + B sin Bx) 
III. Let 
f (x) = P (x) e** cos Bx + Q (x) e°* sin Bx 


where P(x) and Q(x) are polynomials in x. Then: 
(a) if the number «+ fi is not a root of the auxiliary polyno- 
mial, then we seek the particular solution in the form 
y* = U (x) e™* cos Bx + V (x) e** sin Bx 
where U (x) and V(x) are polynomials of degree equal to the 
highest degree of the polynomials P(x) and Q (x); 

(b) if the number «+i isa root of multiplicity p of the auxi- 
liary polynomial, then we seek the particular solution in the form 
y* = x" [U (x) e* cos Bx + V (x) e** sin Bx} 

where U (x) and V(x) have the same meaning as in Case (a). 
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General remarks on Cases I! and III. Even when the right side 
of the equation contains an expression with only cosBx or only 
sin Bx, we must seek the solution in the form indicated, that is, 
with sine and cosine. In other words, from the fact that the right 
side does not contain cosfBx or sinfx, it does not in the least 
follow that the particular solution of the equation does not contain 
these functions. This was evident when we considered Examples 4, 
5, 6 of the preceding section, and also Example 2 of the present 
section. 

Example 1. Find the general solution of the equation 

yV — y= +l 
Sofution. The auxiliary equation kł—1=0 has the roots 

k=l, ky=—l, k=i, ky=—i 
We find the general solution of the homogeneous equation (see Example 4, 
Sec. 1.22): 

y= Cye* +Cye-* + Cy cosx-+C, sinx 
We seek the particular solution of the nonhomogeneous equation in the form 

y’ = Ags? + ArH Aat As 
Differentiating y* four times and substituting the expressions obtained into 
the given equation, we get 
— A — Ayx?— Ax — Ag = H l 
Equating the coefficients of identical powers of x, we have 
— =l, —A,=0, —A,=0, —A3=1 


y*=— 8—1 


The general solution of the nonhomogeneous equation is found from the formula 
y=yty*: 


Hence 


y = Cye* +-Cye-* + C3 cos x+ C, sin x— x3 — l 
Example 2. Solve the equation 
yV — y = 5 cos x 


Solution. The auxiliary equation kt—1=0 has the roots k =1, kg =—I, 
k3=i, ką=— i. Hence, the general solution of the corresponding homogeneous 
equation is 


y = Cye*+Cye-*+C, cosx--C, sinx 
Further, the right side of the given nonhomogeneous equation has the form 


f(x)=Mcosx+WN sinx 
where M=5 and N =0. 
Since i is a simple root of the auxiliary equation, we seek the particular 
solution in the form 
y* =x (A cos x+ B sin x) 


Putting this expression into the equation, we find 
4A sin x— 4B cos x =5 cos x 
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whence 
4A=0, —4B=5 


or A=0, B=—Ž. Consequently, the particular solution of the differential 


equation is . 


ra rany 
peg 
and the general solution is 


y=Cye* + Cye-* +C cos x+C, sin roe sin x 


1.26 THE DIFFERENTIAL EQUATION 
OF MECHANICAL VIBRATIONS 


In this and the following sections we will consider a problem 
in applied mechanics and will investigate and solve it by means 
of linear differential equations. 

Let a load of mass Q be at rest on an elastic spring (Fig. 25). 
We denote by y the deviation of the load from the equilibrium 
position. We shall consider deviation downwards as positive, 
upwards as negative. In the equilibrium position, the weight is 
balanced by the elasticity of the spring. Let us suppose that 
the force that tends to return the load to equilibrium (the so-called 
restoring force) is proportional to the deflection, that is, equal 
to —ky, where k is some constant for the given spring (the 
so-called “spring rigidity”). * 

Let us suppose that the motion of the load Q is restricted by 
a resistance force operating in a direction opposite to that of 
motion and proportional to the velocity of the load relative to 
the lower point of the spring; that is, a force —ry=— ad, 
where A=const > 0 (shock absorber). Write the differential equa- 
tion of the motion of the load on the spring. By Newton’s second 
law we have 


d? d 
Q= kya% (1) 


(here, k and à are positive numbers). We thus have a homoge- 
neous linear differential equation of the second order with con- 
stant coefficients. 

This equation may be rewritten as follows: 


@ d , 
Lr tp += (1’) 


* Springs whose restoring force is proportional to the deflection are called 
springs with a “linear characteristic”. 


7—2082 
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where 
a k 
aaa Be 1= 7 


Let it further be assumed that the lower point of the spring A 
executes vertical motions under the law z=ọ (t). This will occur, 
for instance, if the lower end of the spring is attached to a rol- 
ler, which moves over an uneven spot together with the spring 
and the load (Fig. 26). 


a 


Equilibrium, 


position 


Fig. 25 Fig. 26 


In this case the restoring force will be equal not to — ky, but 
to — k [y+ ọ (£)], the force of resistance will be — À [y + p (¢)], 
and in place of equation (1) we will have the equation 


QS 4 AH + ky = — ko (t) —Ag' (6) (2) 
or 
SE 4 pHs qy=f() (2’) 
where 


kp (t) tag’ (t 
f(ij=— Og p(t) 


We thus have a nonhomogeneous second-order differential 
equation. 

Equation (1’) is called an equation of free oscillations, equation (2’) 
is an equation of forced oscillations. 


1.27 FREE OSCILLATIONS 


Let us first consider the equation of free oscillations 
y’+py'+qy=0 (p>0, g>0; see Sec. 1.26) (1) 
We write the corresponding auxiliary equation 
«+ pk-+q=0 
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and find its roots: 
p P p p? 
h=—2+ y 5a k=- VF 


(1) Let E> gq. Then the roots k, and k, are real negative num- 


bers. The general solution is expressed in terms of exponential 
functions: 


y=C, e*t} Cett (k, <0, k, <0) (2) 


From this formula it follows that the deviation of y for any 
initial conditions approaches zero asymptotically if £— oo. In the 
given case, there will be no oscillations, since the forces of resist- 
ance are great compared to the coefficient of rigidity of the 
spring k. 


(2) Let Pag then the roots k, and k, are equal (and are 


4 
also equal to the negative number — $) Therefore, the general 
solution will be 
224 -24 _ pt 
y=Ce ? +C,te * =(C,+C,t)e ? (3) 


Here the deviation also approaches zero as t—+oo, but not so 
rapidly as in the preceding case (due to the factor C, + Ct). 
(3) Let p =O (no resistance). Equation (1) is of the form 
y"+qy=0 (4) 
The auxiliary equation is k?+q=0 and its roots are k,=Bi, 
k,=—fi, where B=V q. The general solution is 
y == C, cos Bi + C, sin Bt (5) 
In the latter formula, we replace the arbitrary constants C, 


and C, with others. We introduce the constants A and P., which 
are connected with C, and C, by the relations 


C,=Asing,, C= Acoso, 
A and gq, are defined as follows in terms of C, and C: 
A=VC?+C}, 9,= arctan & 
Substituting the values of C, and C, into formula (5), we get 
y= Asin Qp, cos Bi + A cos q, sin Bt 
or 


y= Asin (Bt + 9) (6) 
7* 
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These oscillations are called harmonic. The integral curves are 
sine curves. The time interval T, during which the argument of 
the sine varies by 2n, is called the period of oscillation; here, 


THF. The frequency is the 


number of oscillations during 
time 2m; here, the frequency 
is p; A is the greatest devia- 
tion from equilibrium and 
is called the amplitude; g, is 
the initial phase. The graph 
of the function (6) is shown 
in Fig. 27. 

In electrical engineering and elsewhere, wide use is made of 
complex and vectorial representations of harmonic oscillations. 

Let us take the complex plane xOy and consider a radius vector 
A=A (t) of constant length | A |= A = const. 

As the parameter ¢ varies (here, ¢ is the time), the terminus 
of the vector A describes a circle of radius A centred at the coor- 
dinate origin (Fig. 28). Suppose the angle formed by the vector A 
and the x-axis is expressed thus: p= {t+ @,. Then ß is called the 
angular velocity of the vector A. The 
projections of A on the y- and x-axes 


are 
y= Asin (Bt + 9) (7) 
x= Acos (Bt + po) 
The expressions (7) are the solutions 
of equation (4). 
We consider the complex quantity 
z=x+iy= 
= A cos (Bt + P.) + iA sin (Bt + 9) 


y —-y=Asin( At+g) 


or 
z= A [cos (Bt + p.) + isin (Bt + 9)] (8) 


As was pointed out in Sec. 7.1, Vol. I, the complex quantity z 
in (8) is represented by the vector A. 

Thus, the solutions to the equation of harmonic oscillations (4) 
may be regarded as the projections of the vector A on the y- and 
hai the vector with initial phase g, rotating with angular ve- 
ocity R. 

Using the Euler formula [see (4), Sec. 7.5, Vol. I], the expres- 
sion (8) may be rewritten as 


z= Ae! (Bt +9) (9) 
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The imaginary and real parts of (9) are solutions of equation (4). 
Expression (9) is called the complex solution of (4). Wecan rewrite (9) 
as follows: 


z= Aelvoeibt * (10) 


The expression Ae’% is called the complex amplitude. We denote 
it by A*. Then the complex solution (10) can be rewritten as 


z = Ate!bt (11) 
(4) Let p0 and F<. 


Fig. 29 


In this case, the roots of the auxiliary equation are complex 
numbers: 


kı =a+iß, k,=a—iß 


__ Pp _ p? 
a=— 7 <0, p= Vie 
The general solution has the form 
y =e% (C, cos Bt +C, sin Bt) (12) 


where 


or 
y = Ae sin (Bt + p.) (13) 


Here, for the amplitude we have to consider the quantity Ae 
which depends on the time. Since a <0, it approaches zero as 
t—+oo, which means that here we are dealing with damped oscil- 
lations. The graph of damped oscillations is shown in Fig. 29. 
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1.28 FORCED OSCILLATIONS 
The equation of forced oscillations has the form 
y’+py+qy=f(t) (p>90, q>0; see Sec. 1.26) (1) 
Let us consider an important practical case when the disturb- 
ing external force is periodic and varies under the law 
f(t) =asin of 
then the equation will have the form 
y" + py’ + qy =asin ot (1’) 
(1) Let us first presume that p0 and o <q, that is, the 
roots of the auxiliary equation are the complex numbers @ + if. 
In this case [see formulas (12) and (13), Sec. 1.27], the general 
solution of the homogeneous equation has the form 
Y= Ac*sin (Bt + @) (2) 
We seek a particular solution of the nonhomogeneous equation 


in the form 
y* = M cos ot + N sin ot (3) 
Putting this expression of y* into the original differential equa- 
tion, we find the values of M and N: 
EE Oe = (oa 
ug (q—*)? + Po?’ Me (q—«?)? + po? 
Before putting these values of M and N into (3), let us introduce 
the new constants A* and ọ*, setting 
M=A'*sing*, N= A*cosq* 
that is 


A-V PE = tan gr = 


a 
Then the particular solution of the nonhomogeneous equation may 
be written in the form 
y* = A*sin ọ* cos wt + A* cos ọ* sin œt = A* sin (wf + @*) 
or, finally, 


OS so En : * 
P= Tarai par orto) 


The general solution of equation (1) is y=y+y* or 


y = Ae“ sin (Bt + p.) + qari (wt + @*) 
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The first term of the sum on the right side (the solution of the 
homogeneous equation) represents damped oscillations; it dimini- 
shes with increasing ¢ and, consequently, after some interval of 
time the second term (which determines the forced oscillations) 
will dominate. The frequency w of these oscillations is equal to 
the frequency of the external force f (t); the amplitude of the forced 
vibrations is the greater, the smaller p and the closer œ? is to g. 

Let us investigate more closely the dependence of the amplitude 
of forced vibrations on the frequency œ for various values of p. 
For this, we denote the amplitude of forced vibrations by D(a): 


a 
VG—o + phot 
Putting g= 6? (for p=0, B, would be equal to its natural fre- 
quency), we have 


D (o) = 


D (@) = a SS oe 
V (Bi—o?)?+ p'o? gy (1 _ 92)" PE ot 
Bi/ pipi 
Introducing the notation 
Ma Pa 
cae ame 


where A is the ratio of the frequency of the disturbing force to 
the frequency of free oscillations of the system, and the constant y 
is independent of the disturbing force, we find that the magnitude 
of the amplitude will be expressed by the formula 


R a 

DN = VT (4) 
Let us find the maximum of this function. It will obviously be 
for that value of A for which the denominator has a minimum. 
But the minimum of the function 


Ve 6) 
is reached when 
a= y ta 
2 


and is equal to 


Vink 


Hence, the maximum amplitude is equal to 


D. pan ees 
? aa 


D max = 
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The graphs of the function D(A) for various values of y are shown 
in Fig. 30 (in constructing the graphs we put a=1, B,=1 for 
the sake of definiteness). These curves are called resonance curves. 

From formula (5) it follows that for small y the maximum 
value of amplitude is attained for values of À close to unity, that 


0S QB 0 125 15 15 20 
Fig. 30 


is, when the frequency of the external force is close to the fre- 
quency of free oscillations. If y=0 (hence, p= 0), that is, if there 
is no resistance to motion, the amplitude of forced vibrations 


increases without bound as A—+1 or as o—+$,=Vq: 
lim D (A) = œ 
A> 1 
(y=0) 
At w*=q we have resonance. 
(2) Now let us suppose that p=0; that is, we consider the 


equation of elastic oscillations without resistance but with a 
periodic external force: 


y’+ qy =asinot (6) 
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The general solution of the homogeneous equation is 
y=C,cospt+C,sinBt  (p?=q) 


If Bo, that is, if the frequency of the external force is not 
equal to the natural frequency, then the particular solution of 
the nonhomogeneous equation will ,, 
have the form y 

y* = M cos ot + N sin wt 


Putting this expression into the 
original equation, we find 


M=0, N=—; 


y's y's-zytcos pt 
a=const 
f=const 


q— =e 
The general solution is 


y= Asin (Be +) + -— —*< sin wt 


Thus, motion results from the super- 
position of a natural oscillation with 
frequency f and a forced vibration . 
with frequency o. 

If B=o, that is, the natural fre- 
quency coincides with the frequency 
of the external force, then function @) 
is not a solution of equation (6). Fig. 31 
this case, in accord with the ae 
of Sec. 1.24, we have to seek the particular solution in the form 


y* = t (M cos Bt + N sin ĝt) (7) 
Substituting this expression into the equation, we find M and N: 
M= = , N=0 


Consequently, 
y=— F t cos ĝt 


The general solution will have the form 
y= Asin (BE + Po) — zp t cos Bt 


The second term on the right side shows that in this case the 
amplitude increases without bound with the time ¢. This pheno- 
menon, which occurs when the natural frequency of the system 
coincides with the frequency of the external force, is called 
resonance. 

The graph of the function y* is shown in Fig. 31, 


106 Ch. 1 Differential Equations 


1.29 SYSTEMS OF ORDINARY DIFFERENTIAL EQUATIONS 


In the solution of many prene it is required to find the 


functions y, = y4, (x), Ya=Ya(x), ---, Yn=Yn (x), which satisfy a 
system of \ifferential” “equations containing the argument x, the 
unknown functions y,, Yz} ---, Y„ and their derivatives. 
Consider the following system of first-order equations: 

d 

= = fi (x, Yis Yor +--> Yn) } 

a 

Hefa lX, Yas Yas -++ Yn) | a) 


where y,, Ya ---, Yn are unknown functions and x is the argument. 
A system of this kind, where the left sides of the equations 
contain first-order derivatives, while the right sides do not contain 
derivatives, is called normal. 
To integrate the system means to determine the functions 
Yr» Yas +++» Yn, Which satisfy the system of equations (1) and the 
given initial conditions: 


(Y:)x2x, = Yio» (Yo) x= x, = Yas ves (Yn)x=x, = Yno (2) 


Integration of a system like (1) is performed as follows. Differen- 
tiate the first equation of (1) with respect to x: 


ay, =h aah Mig., +H h si iyn 


dx? Oy, dx 
Replacing the derivatives m, cts vet , Ya with their expressions 
fi» fas «++» f, from equations (1), we get. the equation 
d2 
SES F(X, Yas oe es On) 


Differentiating this equation'and then doing as before, we obtain 
d? 
TA =F, (t Yi Yar +++ Ya) 
Continuing in the same fashion, we finally get the equation 


d” 
r Pee p In) 
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We thus get the following system: 
d 
Bt B(x, Yi -ees Yn) l 


d? 
Sh =F, (x, Yis ++ +5 Yn) (3) 
d” 
T = F, (x, Ys vers Yn) 

From the first n— 1 equations we determine (if this is possible) 
Yar Ya» +++) Yn and express them in terms of x, y, and the deri- 
dy, dy, d”-!y,, 

dx? dx?’ °° 7°? danmi 
Y= Pa (X, Yrs Yrs +++ YI) 
Ys = Pa (Xs Yis Yi -s YP) (4) 


rer 


vatives 


Yn = Pr (xX, Yi» Yi» sty yy?) 
Putting these expressions into the last of the equations (3), we 
get an nth-order equation for determining y,: 


dry, 


ASD (x, ee -s YE) (5) 

Solving this equation, we find y,: 
Y=, (x, Cis Ca <.. Cn) (6) 
Differentiating the latter expression n—1 times, we find the 
derivatives n A; om oon as functions of x, C,, Ca, ..., Cy. 


Substituting these functions into equations (4), we determine 


Yor Ysr ++ +5 Yn: 
Yo = Pz (x, C,, C,, sees 7 


os 


(7) 
Yn = Yn (x, C,, Ce Sues Cn) 

For this solution to satisfy the given initial conditions (2), it 
remains for us to find [from equations (6) and (7)] the appropriate 
values of the constants C,, C,, ..., C, (like we did in the case 
of a single differential equation). 

Note 1. If the system (1) is linear in the unknown functions, 
then equation (5) is also linear. 

Example 1. Integrate the system 


dy _ dz _ 
Wen tet x, ax AY 82+ 2x (a) 
with the initial conditions 
(Y)x=0=!l, (Z)x=0=0 (b) 
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Solution. (1) Differentiating the first equation with respect to x, we have 


dy dy , dz 
dit det det 
: ‘ dy dz , ; s 2 
Putting the expressions 7 and T from equations (a) into this equation, 
we get 
dty 
aa WY Fee) + (—4y —32 + 2x) +1 
Se : 
PY By 224 3x41 (c) 


(2) From the first equation of system (a) we find 
zt y—x (d) 


and put it into the equation just obtained; we get 


or 
Thott ysel (e) 


The general solution of this equation is 
y = (Cı + Cox) e7 * + 5x—9 (f) 
and from (d) we have 
z= (C, — 2C, —2C,x) e~* — 6x + 14 (g) 
Choosing the constants C, and Ca so that the initial conditions (b) are 
satisfied, 
U)x=0= 1, (Z)x=0=0 
we get, from equations (f) and (g), 
1=C,—9, 0=C,—2C,+ 14 
whence C= 10 and C,=6. 
Thus, the solution that satisfies the given initial conditions (b) has the form 
y= (10+ 6x) e-*¥+5x—9, z= (—14—12x) e-*—6x-+ 14 
Note 2. In the foregoing we assumed that from the first n—1 
equations of the system (3) it is possible to determine the functions 
Yo, Ys, »++» Yn. It may happen that the variables y,, ..., y, are 


eliminated not from n, but from a smaller number of equations. 
Then to determine y, we will have an equation of order less than n. 


Example 2. Integrate the system 


dx dy dz 
nye agate t? g * ty 
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Solution. Differentiating the first equation with respect to ¢, we find 


Ta gt great ety) 


Eliminating the variables y and z from the equations 
dx dx 
aay te game ty+z 
we get a second-order equation in x: 
dx dx 


ae ap —**=° 
Integrating this equation, we obtain its general solution: 
x=Cye-'+C,e%t (a) 
Whence we find 
ot —Cye-t-+ 2Ce?t and y= = —z=—Cye-t4+2C,e2t —2 (B) 


Putting into the third of the given equations the expressions that have been 
found for x and y, we get an equation for determining z: 


qr += 30e 
Integrating this equation, we find 
z= Cye-t +-Cyett (y) 
But then, from equation (B), we get 
y= —(Ci+C,) e-t + Cet (ô) 


Equations (æ), (y), and (5) give the general solution of the given system. 


The differential equations of a system may contain higher-order 
derivatives. This then yields a system of differential equations of 
higher order. 


For instance, the problem of the motion of a material point under the action 
of a force F reduces to a system of three second-order differential equations. 
Let F,, Fy, Fz be the projections of the force F on the coordinate axes. The 
position. of the point at any instant of time ¢ is determined by its coordinates x, 
y, and z. Hence, x, y, z are functions of ¢. The projections of the velocity vec- 
dx dy dz 
dt’ dt’ dt ` 

Suppose that the force F and, hence, its projections Fy, Fy, F, depend on 
the time ¢, the coordinates x, y, z of the point, and on the velocity of motion 
Í the point, that is, on, &% , & 
of the point, that is, on -F° Gre Gp: 

In this problem the following three functions are the sought-for functions: 


x=x (t), y=y (t), z=2(t) 


tor of the point on the axes will be 
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These functions are.determined from equations of dynamics (Newton's law): 


ax f dx dy dz 

mapa Fst x nai 4, =) | 2 
ay dx dy dz 

maa = Fy (+, x, Y, Z, -F ’ a’ =) | (8) 
dz dx dy dz 

moe F(t 4, Y, as Gee a) j 


We thus have a system of three second-order differential equations. In the case 
of plane motion, that is, motion in which the trajectory is a plane curve (lying, 
for example, in the xy-plane), we get a system of two equations for determin- 
ing the functions x (£) and y (£): 


ax dx dy 

moana Fa(t x, Yo? +) (9) 
dy dx dy 

m= F(t, x, 9? a) (10) 


It is possible to solve a system of differential equations of higher order by 
reducing it to a system of first-order equations. Using equations (9) and (10) as 
examples, we shall show how this is done. We introduce the notation 


dx _ dy 
aTe gg 
Then 
dx du  dy_ d 
d? dt’ dt? dt 


The system of two second-order equations (9) and (10) in two unknown func- 
tions x(t) and y(t) is replaced by a system of four first-order equations in four 
unknown functions x, y, u, v: 


ae, 
dt 
dy _ 
a.” 
du 
maa P st x, Y, u, v) 
dv 


m- Fv (t, x, y, u, v) 


We remark in conclusion that the general method that we have considered of 
solving the system may, in certain specific cases, be replaced by some artificial 
technique that gets the result faster. 


Example 3. Find the general solution of the following system of differential 
equations: 
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Solution. Differentiate both sides of the first equation twice with respect 
to x: 


dy _ d'z 
“dxt dx? 


2 
But Stay, and so we get a fourth-order equation: 


diy _ 
dxe TY 
Integrating this equation, we obtain its general solution (see Sec. 1.22, 
Example 4): 
y =C e* +C- * 4C cos x+C, sinx 


Finding tt z from this equation and putting it into the first equation, we find z: 


z= Ce” -+Cye-* —C3 cos x— C, sin x 


1.30 SYSTEMS OF LINEAR DIFFERENTIAL EQUATIONS 
WITH CONSTANT COEFFICIENTS 


Suppose we have the following system of differential equations: 
a = QX F Aia + -© FH On Xp | 
d 
a = Aai + QX t +++ + AonXn a| (1) 
| 
) 


dx 
PTa = Am¥ı at AnoX2 +. -+ Annn 


where the coefficients a;; are constants. Here, ¢ is the argument, 
and x, (t), x, (t), ...,, (¢) are the unknown functions. The system (1) 
is a system of homogeneous linear differential equations with con- 
stant coefficients. 

As was pointed out in the preceding section, this system may 
be solved by reducing it to a single equation of order n, which 
in the given instance will be linear (this was indicated in Note 1 
of the preceding section). But system (1) may be solved in 
another way, without reducing it to an equation of the nth order. 
This method makes it possible to analyze the character of the 
solutions more clearly. 

We seek a particular solution of the system in the following 
form: 


y= ae, X= ae", vey MQ anett (2) 


It is required to determine the constants @,, @, ..., @, and k 
in such a way that the functions a,e*!, ae, ..., a,e*' should 
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satisfy the system of equations (1). Putting them into system (1), 
we get: 

ka,ett = (yyy + yyy + «+. + ainan) OM ` 

ka,et! = (y4%, + aata +. -© + aonn) OM 


kd geht = (yy + anta +--+ annan) e 
Cancel out e*t. Transposing all terms to one side and collecting 
coefficients of a,, @, ..., &,, we get a system of equations: 
(a, —k) a, + a+... + Ann =0 
antt (Ap —F) t+... + Ay_%, = 0 


eo © © © e © © o o © © ù o o © © © © © o o 


an% + Anta + - ++ + (Ann — k) an= 0 


Choose @,, %, ..., &, and k such that will satisfy the system (3). 
This is a system of linear algebraic equations in @,, @, ..., @ 
Let us form the determinant of system (3): 


Q,—R Qe «+s Ay, 


(3) 


ne 


id aa ee asian: (4) 
any ano: ann —k 

If k is such that the determinant A is different from zero, then 

system (3) has only trivial solutions a,=a,=...=a,=0 and, 
hence, formulas (2) yield only trivial solutions: 
x, (=x, (t)=... =x, (t) =0 


Thus, we obtain nontrivial solutions (2) only for k such that 
the determinant (4) vanishes. We arrive at an equation of order n 
for determining k: 


a,—Rk ay, Qin 
ay, a,,—k Arn 
=0 (5) 
any Ane Agn—k 


This equation is called the auxiliary equation of the system (1), 
and its roots are the roots of the auxiliary equation. 

Let us consider a few cases. 

I. The roots of the auxiliary equation are real and distinct. 
Denote by &,, k, ..., &, the roots of the auxiliary equation. For 
each root k; write the system (3) and determine the coefficients 


diy i) () 
Qe Gs y ee 
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It may be shown that one of them is arbitrary; it may be consi- 
dered equal to unity. Thus we obtain: 
for the root k, the following solution of the system (1) 


xp = aWekit, x = aWekit, 3 P= alh ekt 
for the root k, the solution of the system (1) 
x) = alPekat i xi) = al2ekat | wee KOS oni?) ekst 


for the root &, the solution of the system (1) 

xi) = afekt, x= aek, |., xP = amen 
By direct substitution into the equations we see that the system of 
functions 

X= Ca Pert + CraPets! t... Cpa Ment 

X = Capen + Cae +... + CaM ernt 


e ee eae eee ee (6) 
Xa = Cyaelst 4+ CaPert +... 4C,ametnt 
where C,, Ca, ..., C,, are arbitrary constants, is likewise a solution 


of the system of differential equations (1). This is the general 
solution of system (1). It may readily be shown that one can find 
values of the constants such that the solution will satisfy the 
given initial conditions. 
Example 1. Find the general solution of the system of equations 
dx dx. 
Gp 7 ei + 2e, an =x, 13x, 
Solution. Form the auxiliary equation 
2—k 2 
1 3—k 
or k2—5k+4=0. Find its roots: 
k,=1, ko=4 
Seek the solution of the system in the form 


xb 


=aP et, xf) = aPet 
and 
PaP gat, xai ett 


Form the system (3) for the root k= 1 and determine a” and as): 
(2-1) aj +2ag"==0 | 
lai? +(3-1)as?=0 f 
or 
aP + 208 —0 
3 ai) 4 205) =0 
8— 2082 
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whence a3” = —ta i. Putting a =1, we get aP = —+ Thus, we obtain 


the solution of the system: 


(1) l 


Det, x} =-ze 


xi 


Now form system (3) for the root ka= 4 and determine a{” and af 


— aP 2af —0 
a — a =0 
whence af? =a?) 
system: 


and a{? =1, af? —=1. We obtain the second solution of the 


x?) — ett, xP est 
The general solution of the system will be [see (6)] 
=C,e'+ C,e% 


X = —t Cyet+ Cye4t 


Il. The roots of the auxiliary equation are distinct, but include 
complex roots. Among the roots of the auxiliary equation let there 
be two complex conjugate roots: 

k,=a+ip, k&,=a—ifp 
To these roots will correspond the solutions 


xPa=aMeetint (j=1, 2, ..., A) (7) 

xls ent (j=1, 2, ..., n) (8) 

The coefficients aj and aj? are determined from the system of 
equations (3). 

Just as in Sec. 1.21, it may be shown that the real and imagi- 


nary parts of the complex solution are also solutions. We thus 
obtain two particular solutions: 


= ae 
xj) =e (Aj? cos Bx+Aj” sin Bx) | (9) 
x@ =e" (AM sin Bx-+ A?) cosBx) | 

where A}, A9, AM, a are real numbers determined in terms of 

a and. a! 


Appropriate combinations of functions (9) will enter irito the 
general solution of the system. 


Example 2. Find the general solution of the system 


dx, 
aT 7x1 + Xa 


Dr __ 9, 5x, 
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Solution. Form the auxiliary equation 
—7—k 1 KS 
—2 —5—k| 
or k?+ 12k +37 =0 and find its roots: ‘ 
ki=—64+i, hky=—6—i 
Substituting kı =—6-+i into the system (3), we find 
aP=1, aP=l+i 


0 


We write the solution (7): 


xP = tel-84Dt  xP=(1+i)e-t+dt {7’) 
Putting kg =—6—i into system (3), we find 
aP =l, a =1—i 
We get a second system of solutions (8): 
xM@mel-e-ht,  x® (1 i) el-8-t (8’) 


Rewrite the solution (7’): 
xi) = e-6t (cos ti sin t) 
xg) = (1 -Li) e~ 8t (cos t +i sin £) 


xi) — e=6t cos t+ ie~8t sin t 

x4) = e-5t (cos t— sin t) + ie-*t (cos f+ sin 1) 
Rewrite the solution (8’): 

x2) = e-*t cos t—ie-8t sin t 

x2) = e-6t (cos t— sin ¢) — ie~* (cos ¢ + sin t) 
For systems of particular solutions we can take the real parts and the imagi- 
nary parts separately: 

xP = e-8t cost, XP = e-8t (cos t —sin t) \ 9") 


x =e-6t sint, x2) =e-8t (cos t+ sin t) 
The general solution of the system is 

xı =C,e~ ®t cos t + Cye- 8 sin £ 

Xa = Ce ~ ®t (cos t — sin t) + Cye—8 (cos t+ sin £) 


By a similar method it is possible to find the solution of a system 
of linear differential equations of higher order with constant coef- 
ficients. 

For instance, in mechanics and electric-circuit theory a study 
is made of the solution of a system of second-order differential 
equations: 

dy 

Ge T aX + Uy : 

= (10) 
y 

GE = la” + lY 


116 Ch. 1 Differential Equations 


Again we seek the solution in the form 
x=aett, y= felt 


Putting these expressions into system (10) and cancelling out e*t, 
we get a system of equations for determining a, B and k: 


(a,,—*?)a+a,.8 =0 \ (11) 
1% + (A. — k?) P =0 
Nonzero a and f are determined only when the determinant of 
the system is equal to zero: 
a — k? aiz 


ay ay. — k? z (1a) 


This is the auxiliary equation of system (10); it is a fourth-order 
equation in k. Let k,, k,, ka, and k, be its roots (we assume that 
the roots are distinct). For each root k; of system (11) we find 
the values of æ and B. The general solution, like (6), will have 
the form 

x = Ca Pekt + C aDeht C aert + CraMert 

y — C,pMert + CP@e*at + Caf e*t + C,pMert 


If there are complex roots, then to each pair of complex roots 
in the general solution there will correspond expressions of the 
form (9). 


Example 3. Find the general solution of the following system of differential 
equations 
d*x 


ae Tt 
d? 
qamri 


Solution. Write the auxiliary equation (12) and find its roots: 


1—k? —4 


—ı 1—2|70 


kı=i, ke=—i, ką=V 3, kg=—Y 3. 


We shall seek the solution in the form 


x) = qa) elt, yD) = pm eit 
x?) — ql?) en it, yD — BQ) e-t, 


xO) = a8)" 81 ys) — Bay el 3t 


x) = alte“ lst, yi pane Vat 


1.31 On Lyapunov'’s Theory of Stability 117 


From system (11) we find & and BY): 


1 
= M= 
a 1, B 7 
al?) =] pot i 
2 
a®—1, pe—— L 
: 2 
awl, p= L 
i 2 
We write out the complex solutions: 
xD = elf — cos t+ isin t, m=} (cos t+ i sin £) 


x(2) =e-İt= cos t—isin t, y®=- (cos t—i sin ft) 
The real and imaginary parts separately form the solution: 


x) = cos f, wat cos t 
x) — sin t, p=5 sint 


We can now write the general solution: 


x= C, cos +C sin t+ Ce” 3! +C 8 
y too ce at 


v=5 6 cos t456: sin t—-4 Cse 

Note. In this section we did not consider the case of multiple 

roots of the auxiliary equation. This question is dealt with in 

detail in “Lectures on the Theory of Ordinary Differential Equa- 
tions” by I. G. Petrovsky. 


1.31 ON LYAPUNOV’S THEORY OF STABILITY 


Since the solutions of most differential equations and systems 
of equations are not expressible in terms of elementary functions 
or quadratures, use is made of approximate methods of integration 
in these cases when solving concrete differential equations. The 
elements of these methods were given in Sec. 1.3; some of these 
methods will also be considered in Secs. 1.32-1.34 and in 
Chapter 4. 

The drawback of these methods lies in the fact that they yield 
only one particular solution; to obtain other particular solutions, 
one has to carry out all the calculations again. Knowing one par- 
ticular solution does not permit us to draw conclusions about the 
character of the other solutions. 
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In many problems of mechanics and engineering it is sometimes 
important to know not the specific values of a solution for some 
concrete value of the argument, but the type of behaviour for 
changes in the argument and, in particular, for a boundless increase 
in the argument. For example, it is sometimes important to know 
whether the solutions that satisfy the given initial conditions are 
periodic, whether they approach some known function asymptoti- 
cally, etc. These are the questions with which the qualitative 
theory of differential equations deals. 

One of the basic problems of the qualitative theory is that of 
the stability of the solution or of the stability of motion; this 
problem was investigated in detail by the noted Russian mathe- 
matician A. M. Lyapunov (1857-1918). 

Let there be given a system of differential equations: 


Zh (t, x, y) 
(1) 


d 
F =flt, x, y) 


Let x=x(t) and y=y(t) be the solutions of this system that 
satisfy the initial conditions 


Xt=0 = Xo ; 
Yt=0 = Yo \ (I ) 


Further, let x=x(t) and y=y(t) be the solutions of equation 
(1) that satisfy the initial conditions 


Kren = Xo \ n 
al ake a”) 
Yt=0 = Yo 


Definition. The solutions x=x (t) and y =y (t) that satisfy the 
equations (1) and the initial conditions (1’) are called Lyapunov 
stable as t—»>oo if for every arbitrarily small e œ> © there is a 
6>0 such that for all values ¢ >0 the following inequalities are 


fulfilled: 7 
Ix ()—x (H) <e ) É 
ly(t)—y(t)|<e 
if the initial data satisfy the inequalities 
| %p—%o | <6 \ 
= 3 
lYo— y| < ô (3) 


Let us figure out the meaning of this definition. From inequa- 
lities (2) and (3) it follows that for small variations in the initial 
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conditions, the corresponding solutions differ but little for all positive 
values of ¢. If the system of differential equations is a system that 
describes some motion, then in the case of stability of solutions, 
the nature of the motions 
changes but slightly for 
small changes in the initial 
data. 


Let us analyze an example 
of a first-order equation. 

Suppose we have the diffe- 
rential equation: 


dy 


Go ee (a) Fig. 32 
The general solution of this equation is the function 
y=Ce-t+1 (b) 
Find a particular solution that satisfies the initial condition 
Ytao= 1 (c) 


It is obvious that the solution y=1 results when C=O (Fig. 32). Then find 
the particular solution that satisfies the initial condition 


Yt=0= Yo 
Find the value of C from equation (b): 

Yo=C+1 
whence _ 

C=y,—1 


Putting this value of C into equation (b), we get 
y=(Yo—l)e-?+ 1 
The solution y=1 is obviously stable. Indeed, 
9—¥=[Yo—l)e~* + 1]—1=(Yo—l)e-# +0 
when ¢ + œ. 


Hence, inequality (3) will be fulfilled for an arbitrary e if the following 
inequality holds true: 


(Yo—!)=b<e 
If the equations (1) describe motion and the argument ż, the 
time, is being given implicitly, that is, if we have a system of 
the form 
d. 
Gah (x, y) 
d 
T= falx, y) 


then this system is termed autonomous, 
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Let us also consider the following system of linear differential 
equations: 


Z ext gy 
4 
W asoy (4) 


We assume that the coefficients a, b, c, g are constants; by direct 
substitution it is clear that x=0, y=0 is a solution of the sys- 
tem (4). Let us investigate the question of the conditions that 
must be satisfied by the coefficients of the system so that the 
solution x=0, y= 0 is stable. This investigation is done as follows. 


Differentiate the first equation and eliminate y and ca on the 


basis of the equations of the system 


d? d d d. d 
Grace +e =e a + a (art by)=c- +gax+b (ox) 


or 


d? dx 
Ga — (+0) g —(ag—be) x =0 (5) 
The auxiliary equation of the differential equation (5) is of the form 
àz— (b-+c) A— (ag —bc) =0 (6) 
This equation may be written in determinantal form: 
c—A g 
a bon (7) 


[see equation (4), Sec. 1.30]. 

We denote the roots of the auxiliary equation (7) by À, and A,. 
As we shall see below, the stability or instability of the solutions 
of system (4) is determined by the nature of the roots A, and A,. 

Let us consider all possible cases. 

I. The roots of the auxiliary equation are real, negative and 
distinct: 2, <0, 4,<¢0, 4,344,. From equation (5) we find 


x == Cie’! + Cet 

Knowing x, we find y from the first equation of (4). Thus, the 
solution of system (4) is of the form: 

x =C, + Ce! } 


y =[C, (4, —c) eh! +C, (M —c) e^t] + (8) 


Note. If g=0 and a20, then we form the equation (5) for 
the function y. Finding y, we then find x from the second equa- 
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tion of (4). The structure of the solutions (8) is preserved. But if 
g=0,a=0, then the solution of the system of equations becomes 

x= Ce, y= Ce! (8’) 


In this case, the analysis of the character of the solutions is 
easier to carry out. Choose C, and C, so that the solutions (8) 
satisfy the initial conditions 


Xlteo= Xo = Yt = Yo 


The solution satisfying the initial conditions will be 


x= CXp + RYo —Xohe ert de Xohı — CXp — Bo eit 
Ay = de Ay SY de (9) 
_ i CX9 + BY — Xho = At Xohı — Xp —EY o pe Aat 
=y [ eae (A, — c) e^t + hiha (Àa — c) e*s 


From these equations it follows that for arbitrary e >0, it is 
possible to select |x,| and |y,| so small that for all ¢>0 it will 
be true that |x(t)|<e, |y(t)|<e since ®t <1, et <1. 

We note that in this case 


lim x(#)=0 | 


t>+ o 
lim y(t)=0 (10) 
t++@ 


Consider the xy-plane. For the system of differential equations (4) 
and for the differential equation (5), this plane is termed the 
phase plane. We will consider the solutions (8) and (9) of system 
(4) as parametric equations of some curve in the phase plane xOy: 


x=9(t, C,, Ca) ) 


= (11 
y=¥(t, Cr C3) ; 
x= (it, Xo» a 
y=v(t, Xo» Yo) (12) 


These curves are the integral curves (solution curves) of the diffe- 
rential equation 


dy _ax+by 


dx cx-+gy 


(13) 


which is obtained from the system (4) by dividing the right and 
left members by each other. 

The origin, O (0, 0), is a singular point of the differential equa- 
tion (13), since this point does not belong to the domain of exis- 
tence and uniqueness of the solution. 
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The nature of the solutions (9) and, generally, of the solutions 
A system (4) is illustrated by the arrangement of the integ- 
ral curves 


F(x, y, C)=0 


which form the complete integral of the differential equation (13). 
The constant C is determined from the initial condition Yx=x, = Yo- 
Substituting the value of C, we obtain the equation of the family 
in the form 


F (x, Y, Xo, Yo) (14) 


In the case of solutions (9), the singular point is called a stable 
nodal point. We say that a point moving along the integral curve 
approaches a singular point without bound as t£ — + oo. 

It is obvious that the relation (14) may be obtained by eli- 
minating the parameter ¢ from the system (12). We will not con- 
tinue the analysis of the arrangement of integral curves near a 
singular point on the phase plane for all possible cases of roots 
of the auxiliary equation and will confine ourselves to an illu- 
stration of this fact in elementary instances that do not require 
unwieldy computations. We note that for arbitrary coefficients the 
behaviour of integral curves of the equation (13) near the origin 
is qualitatively the same as is now to be examined in the follow- 
ing examples. 


Example 1. Investigate the stability of the solution x=0, y=0 of the system 
of equations 


ats 
dt 
dy _ 
at 74 
Solution. The auxiliary equation is 
—l—À 0 
=0 
0 —2— À 


The roots of ihe auxiliary equation are 
Ay=—l, Ag=—2 
In this case, the solutions (8’) will be 
x=Cye-t, y=C,e-*t 
The solutions (9) will be 
x=xe-t,  y=yor*# (a) 


Clearly, x (f) — 0, and y(t)—+0 as t—+-+o. The solution x=0, y=0 is 
stable. Now let us examine the phase plane. Eliminating the parameter ¢ from 
the equations (a), we get an equation of type (14). 


(z)-4 : 
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This is a family of parabolas (Fig. 33). 
The equation of type (13) will, for the given example, be 


dy _ 2y 
dx x : 
Integrating, we get 
In| y[=2In|x|+In|C] (c) 
y= Cx? 
Determine C from the condition 
Yx =% = Yor C= Yo 


2 
Xo 
Substituting the value of C thus found into (c), we get the solution (b). 


The singular point O (0, 0) ts a stable nodal 
point. y 
Il. The roots of the auxiliary equa- 
tion are real, positive and distinct: 
4,>0, 4,.>>0, XÆ, In this case, 
the solutions are also expressed by the A T 
formulas (8) and (9). But in this case, 
for arbitrarily small |x,| and | y| it will 
be true that |x(£)|— œ, |y (t)|— œ 
as £ — + œ, since e^t— oo and e^t —»oo 
as £ — + oo. On the phase plane, the sin- Fig. 83 
gular point is an unstable nodal point: 
as t—+-+ oo the point on the integral curve recedes from the rest 
point x=0, y=0. 


Example 2. Investigate the stability of the solutions of the system 


dx d 
aa ga 
Solution. The auxiliary equation is 
1—A 0 
0 »a\79 
Its solutions are 
Ay=1, Ag=2 


The solution will be 
x= xoet, y=yoert 
The solution is unstable, since | x(t) |—> œ, |y (t)|— œ as ¢—++o. Elimi- 


nating ¢, we obtain 
(z= 
Xo Yo 


(Fig. 34). The singular point O (0, 0) is an unstable nodal point 


HI. The roots of the auxiliary equation are real and of unlike 
sign, for example: 4,>>0, 4,<€0. From formulas (9) it follows 
that for arbitrarily small |x, | and |y,|, if cx»+gy,—x,A,0, it 
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will be true that |x (t)|—+ œ, |y(t)|—+00 as t—++ oo. The solu- 
tion is unstable. The singular point on the phase plane is termed 
a saddle point. 


Example 3. Investigate the stability of the solution of the system 
dx dy _ 
aTe ges 


Solution. The auxiliary equation is 


1—A 0 
=0 
0 Ps 

y 

N 
0 z 

0 x 
Fig. 34 Fig. 35 


hence, Ay=1, Ag=—2. The solution is 
x=xett, y=ye-*t 


The solution is unstable. Eliminating the parameter ¢, we get a family of curves 
on the phase plane: 


yx? = yox 
The singular point O (0, 0) is a saddle point (Fig. 35). 


IV. The roots of the auxiliary equation are complex with ne- 
gative real part: 4,=a-+ if, 4,=a— ip (<0). The solution of 
system (4) is 


x =e [C, cos Bt + C, sin Bt] 

15 
y= : ew! [(aC, + BC, —cC,) cos Bt + (aC, — BC, —cC,) sin Bt] (15) 
Introducing the notation 


C=V GFC, sin 6 = ©, cos6 = & 
C C 
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we can rewrite equations (15) as 


x = Ce% sin (Bt + ô) 
Ceat . ° (16) 
j= [(a—c) sin (B¢ + 6) + Boos (Bt + ô)] | 


where C, and C, are arbitrary constants that are determined from 
the initial conditions: x= x, y=y, when t=0, and 

x, =C sin ô, n=2 [@—0) sin 6 +B cosô] 
whence we find 


Cya%, C= end (17) 


Note again that if g=0, then the form of the solution will be 
somewhat different, but the nature of the analysis does not change. 

It is obvious that for arbitrary e>0, given sufficiently small 
|x,| and |y,|, the following relations will hold: 


Ix@l<e, ly(|<e 
The solution is stable. In this case, as £— + 00, 
x(t)—0 and y(t)—0 


changing sign an unlimited number of times. The singular point 
on the phase plane is called a stable focal point. 


Example 4. Investigate the stability of the solution of the system of equations 


Tae 
dy _ 
ala 


Solution. Form the auxiliary equation and find its roots: 


—l—A’ 1 
z= 2 — 
ee a 0, A?+ 24-+2=0 


Aye=—l tli, a=—l, B=! 


We find C, and C; from formulas (17): Cy=x%», Ca= Y0. Substituting into (15), 
we get 


x=e-1 (xy cos t + yo sin 2) | (A) 
y =e-t (yy cos t — xo sin t) 
It is obvious that for arbitrary values of £, 

|x|<|xo|+] ¥ol, Lyl<lxol+l yol 


As t — + œ, x (t)— 0 and y (#)—+0, and the solution is stable. 
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Let us analyze the arrangement of the curves on the phase plane in this 
case. We transform expressions (A). Let 


xo = M cos 6, Yo = M sind 
M=V ð+,  tand=% 
0 
Then equations (A) become 
x= Me-t cos (Bt — 8) \ 
y = Me-t sin (Bt —8) 


Pass to polar coordinates p and @ in the phase plane and establish the relation- 
ship p =f (6). Equations (B) become 


(B) 


p cos 8 = Me-t cos (Bt — ô) C 
p sin 0 = Me-t sin (Bt — ô) } © 
Squaring the right and left members and adding, we obtain 
p? = M?e-2t 
or 
p= Me-t (D) 


How does ¢ depend on 6? Dividing the terms of the lower equation of (C) by 
the corresponding terms of the upper equation, we get 


tan 0 = tan (Bt — 6) 


whence 
_80+ô 
B 
Substituting into (D), we have 
8+8 
p=Me § 
or 
ob: 8: 
p — Me 6 6 


6 
Putting Me P — Mj, we finally obtain 


6 
p= M,e ®& (E) 


This is a family of logarithmic spirals. In this case, a point moving along an 
integral curve approaches the origin as £ —> œ. The singular point O (0, 0) is 
a stable focal point. 


V. The roots of the auxiliary equation are complex with. positive 
real part: 2, =a + iB, à, =a — ip (a> 0). Here the solution will 
also be expressed by the formulas (15), where a > 0. For arbitrary 
initial conditions x, and y, (Vx3+y?40), |x(t)| and |y(¢)| can 
assume arbitrarily large values as ¢----+ 00. The solution is un- 
stable. The singular point in the phase plane is called an unstable 
focal point. A point on an integral curve recedes without bound 
from the origin of coordinates. 
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Example 5. Investigate the stability of the solution of the system of equations 


dx 
aoe tY 
dy _ E 
nT tY 
Solution. Form the auxiliary equation 
1—A’A 1 
=0, 2—2) 4-2=0 
—I 1—À 5 x7 


Ay=1+i, aAg=l—i 
Taking into account (17), the solution (15) in this case will be 


y 


x= et (x9 cos t+ yy sin t) 
y =e! (y, cos t — xy sin £) 
In the phase plane, we obtain the curve in 
polar coordinates: 
p = Me™ 


The singular point is an unstable focal point 
(Fig. 36). 


VI. The roots of the auxiliary 
equation are pure imaginary: à, = ip, 
à, = — iB. The solutions (15) in this Fig. 36 
case assume the form 
x=C,cosBi+C, sin Bt 
1 (18) 
y= z [(BC, —cC,) cos Bt-++ (—PC,—cC,) sin Bt] 
The constants C, and C, are found from formulas (17): a 


Ci =% C, = Here (19) 


Clearly, for arbitrary e >0 and for all sufficiently small |x,| and 
ly,| it will be true that |x(t)|<.e, |y(t)|< e for arbitrary t. 
The solution is stable. Here, x and y are periodic functions of t. 
In order to carry out the analysis of the integral curves on the 
phase plane, it is advisable to write the first equation of (18) as 
[see (16)] 
x =C sin (Bt + ô) | 
y= cos (Bt -+ 8) — sin(B¢ +ô) J (20) 


where C and ô are arbitrary constants. From the expressions (20) 
it follows that x and y are periodic functions of t. Eliminate the 
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parameter ¢ from (20): 


Eliminating the radical, we get 
c \?_ /CB\? x? 
(0-7) =(F) 0-a) (n 

This is a family of quadric curves (which are real) that depend 
on an arbitrary constant C. Neither of them recedes to infinity. 
Consequently, this is a family of ellipses 
around the origin (for c=0, the axes of the 
ellipses are parallel to the coordinate axes). 
The singular point is termed the centre 
(Fig. 37). 

Example 6. Investigate the stability of the solu- 
tion of the system of equations 


dx __ dy _ 
a! woe 


Solution. Form the auxiliary equation and find 
its roots: 


=0, #44=0, A=+2i 


The solutions (20) will be 
x=C sin (2t +8), 
y =2C cos (2t + 6) 
Equation (21) will assume the form 


x y x2 
pac(i-a) gata! 


We have a system of ellipses on the phase plane, and the singular point is a 
centre. 


VIIL. Let 4,==0, 4,.<¢0. The solution (8) in this case becomes 
x=C,+C,e%! 
y= 2 [—C,c + C, (àp —c) eM] J 


Clearly, for arbitrary e >0 and for sufficiently small |x,| and |y, | 
it will be true that |x(t)|<e, |y(t)|<e when ¢ >0. Hence, the 
solution is stable. 


Example 7. Investigate the stability of the solution of the system 


(22) 


dx _ dy _ 
a= ga a 
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Solution. We find the roots of the auxiliary equation 
—À 0 
= 2+2%=0, A,=0, Ag=—I 
| 0 = S 0, A +A ’ 1 2 
e 
Here, g=0. The solutions are found directly by solving the system and without 
using the formulas (22): 
x=C,, y=Cy,e-t (B) 
The solution satisfying the initial conditions 
X=Xp Y =Y} when ¢=0 is 
%=%,  Y=y7t (y) 
The solution is clearly stable. The differential 


equation on the phase plane will be = 0. The 


complete integral will be x=C. The integral Fig. 38 

curves are straight lines parallel to the y-axis. 

From the equations (y) it follows that the points along the integral curves 
approach the straight line y=0 (Fig. 38). 


VIII. Let 4,==0, 4,>>0. From formulas (22) or (8’) it follows 
that the solution is unstable since | x (¢)|-+ |y (t)|— œ as t — + 00. 
IX. Let à, =, <0. The solution is 


x= (C,+C,t) ed! 


l 23 
y= e [C, M, — e) +0, (14At —ct)] i 
Since e4t—+0 and tes#—+0 as t-—+--oo, then for an arbitrary 
e >0 it is possible to choose C, and C, (by selecting x, and y,) 
such that it will be true that |x(‘)|<e, |y(t)|< e for arbitrary 
{>0. The solution is thus stable, and x(t)-—+0 and y(t)—+0 as 


Example 8. Investigate the stability of the solution of the system 


dx _ dy _ 
aa gad 
Solution. We find the roots of the auxiliary equation: 
—l—aA 0 


= 2 — s = — 
o a7% Q+D=0 M=}=—l 


Here g=0. The solution of the system will be of the form (8’): 
x=Cye-t, y=Cye-t 


and x — 0, y — 0 as t — + œ. The solution is stable. The family of curves 
on the phase plane will be 


ee ae | ee 
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This is a family of straight lines passing through the origin. The points along 
the integral curves approach the origin. The singular point O(0, 0) is a nodal 
point (Fig. 39). 


Note that in the case of à, =’, >0 the form of the solution (22) 
is preserved, but when £ — + co 


|x(t)|—+co and |[y(t)|—+00 


The solution is unstable. 


y 
y 
L 
ie | . 
Fig. 39 Fig. 40 


X. Let 4,==4,==0. Then 
x=C,+C,t 


y=} [—cC, + 0,06] G 


Whence it is quite clear that x—» œo and y— œ as t—++o. 
The solution is unstable. 


Example 9. Investigate the stability of the solution of the system of equations 


dx dy _ 
a =0 


Solution. Find the roots of the auxiliary equation 
—À 1 
| eed =0, Ag=0, A,=A,=0 


We find the solutions to be 
y=Cy, x=Cof+Cy 


It is quite obvious that x —> œ as t—+-+ 0. The solution is unstable. The 


equation on the phase plane is Wo, The integral curves y =C are straight 
lines parallel to the axis (Fig. 40). The singular point is called a degenerate 
saddle point. 


To give a general criterion of the stability of solution of tne 
system (4), we do as follows. 
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We write the roots of the auxiliary equation in the form of com- 
plex numbers: 
Ay = Ay iA 
Aa = Ag + iNe 
(in the case of real roots, Aj*=0 and 3° = 0). 

Let us take the plane of a complex variable A*A** and display 
the roots of the auxiliary equation by points in this plane. Then, 
on the basis of the cases that have been ate 
considered, the condition of stability of 
solution of the system (4) may be for- 
mulated as follows. 

If not a single one of the roots d., A» 
of the auxiliary equation (6) lies to the 
right of the axis of imaginaries, and at 
least one root is nonzero, then the solution 
is stable; if at least one root lies to the 
right of the axis of imaginaries, or both 
roots are equal to zero, then the solution Fie 41 
is unstable (Fig. 41). ig. 

Let us now consider a more general system of equations: 


& — ext gy + P(x, y) 
4 = ax+by+ Q (x, y) 


(25) 


But for exceptional cases, the solution of this system is not expres- 
sible in terms of elementary functions and quadratures. 

To establish whether the solutions of this system are stable or 
unstable, they are compared with the solutions of a linear 
system. Suppose that for x—- 0 and y — 0, the functions P (x, y) 
and Q (x, y) also approach zero and approach it faster than p, 
where p= x" F y7; in other words, 


lim =0; lim 
p>0 p>0 


Qo 
p 


Then it may be proved that, save for the exceptional case, the 
solution of the system (25) will be stable when the solution of 


the system 
ar CX t+ 8Y 
F | (4) 
“a & + by 


is stable, and unstable when the solution of the system (4) is 
unstable. The exception is that case when both roots of the auxil- 
iary equation lie on the axis of imaginaries; then the question of 
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the stability or instability of solution of the system (25) is consi- 
derably more involved. 

Lyapunov * investigated the question of the stability of solutions 
of systems of equations for rather general assumptions concerning 
the form of these equations. 

In oscillation theory, one often has to deal with the equation 


d? d. 

cen (* a) (26) 
Put i 
Then we get the system of equations 

de cci 

dt (28) 

du 

dt TH f (x, v) 


The phase plane for this system is the xv-plane. The integ- 
ral curves on the phase plane geometrically represent the velocity v 
as a function of the x-coordinate and give a pictorial and quali- 
tative description of the variation of x and v. If the point x=0, 
v=0 is a singular point, then it determines a position of equilib- 
rium. 

Thus, for example, if the singular point of a system of equations 
is a centre, that is, the integral curves on the phase plane are 
closed curves circling the origin, then the motions described by 
equation (26) are undamped oscillations. If the singular point of 
the phase plane is a focal point (and then |x|— 0, |v|—-0 as 
t—+oo), then the motions defined by equation (26) are damped 
oscillations. If the singular point is a nodal point or a saddle 
point (and this is the only singular point), then «—++ œ as 
t— oo. In this case a moving material point recedes to infinity. 


If equation (26) is a linear equation of the form oe = axtoS 
then the system (28) looks like 


dx du 
au” qa et bv 


This is a system of type (4). The point x=0, v=0 is a singular 
point, it defines a position of equilibrium. Note that variable x is 
not necessarily a mechanical displacement of a point. It may have 


a variety of physical meanings; for instance, it may represent a 
quantity describing electrical oscillations. 


* A. M. Lyapunov, The General Problem of Stability of Motion, ONTI, 
1935 (in Russian). ‘ 
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1.32 EULER’S METHOD OF APPROXIMATE SOLUTION 
OF FIRST-ORDER DIFFERENTIAL EQUATIONS 


We shall consider two methods of rfumerical solution of first- 
order differential equation. In this section we consider Euler’s 
method. Find (approximately) the solution of the equation 


Z=F (x, y) (1) 


on the interval [x,, b] that satisfies the initial condition at x= x, 
Y = Y,. Divide the interval [x,, 6] by the points xo, x,, Xas ...,x,=6 
into n equal parts (here x, < x, < x <... < Xa). Denote x,—x, = 
= X, — X, =... =b—x,-, = Ax =h; hence, 


pa eae 
n 


Let y=ọ (x) be some approximate solution of equation (1) and 


Yo = P(X), Y1=9 (x), - - -> Yn =P (Xn) 


Put 
AYo = Yı — Yos AY, = Ya— Yr» -- - AYn-1 = Yn— Yn- 
At each of the points x,,x,,...,%, in equation (1) we replace 
the derivative with a ratio of finite differences: 
Ay _ 
54 = F(x, 9) (2) 
Ay = f (x, y).Ax (2’) 


When x=x, we have 
/ 
Aue — F (xo Yo), Ayo = F (Xor Yo) Ax 


or 
Yı — Yo = f (Xo, Yo) h 


In this equation, x,, Y» 4 are known; thus we find 
Y= Yot Í (Xor Yo) A 
When x=x, equation (2’) takes the form 


Ay, =f (x, Yı) h 
or 
Y2—W =F (x, y,)h 
Y=Y +f xy, wh 
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Here, x,, y,, h are known and y, is determined. 
Similarly, we find 


Ys = Ya +f (X25 Yo) h 


ee e. è © > © è ù 


. . è e è è è ù 


Yn = Yn-1 + f (Xn-1 Yn-1) h 


We have thus found the approximate values of the solution at 
the points x,, x,, ...,%,- Connecting, in a coordinate plane, the 
points (xo, Yo), (Xis Yr)s +++» (Sns Yn) by 
straight-line segments, we get a polygonal 
line—an approximate integral curve 
(Fig. 42). This line is called Euler’s poly- 
gon. 

Note. We denote by y=q, (x) an ap- 
proximate solution of equation (1), which 
corresponds to Euler’s polygon when Ax = 
=h. It may be proved * that if there exists 
a unique solution y=@*(x) of equation 
(1) that satisfies the initial conditions and 
is defined on the interval [x,, 6], then 


Fig. 42 
lim| Or (x) — g* (x) | =0 for any x of the interval [x,, b]. 


Example. Find the approximate value (for x=1) of the solution of the 
equation 


y'=y+x 
that satisfies the initial condition yọ=1 for xọ=0. 
Solution. Divide the interval {0, 1] into 10 parts by the points xą=0, 


0.1, 0.2, ..., 1.0. Hence, hA=0.1. We seek the values y;, yg, ..-» Yn by for- 
mula (2'): 


AY n= (Yk + xp) h 


Yk+1= Yk + (Yk + xp) h 


or 


We thus get 
y,=1+(140)-0.1=1-+4+0.1=1.1 
Yg=1.1-+4(1.1-+40.1)-0.1 = 1.22 


Tabulating the results as we solve, we get: 


* For the proof see, for example, I. G. Petrovsky’s Lectures on the Theory 
of Ordinary Differential Equations. 
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| Yk | Yktžk | Ayk=(YRt+Xq) A 


xo =0 1.000 1.000 0.100 
x, =0.1 1.100 1.200 0.120 
Xa =0.2 1.220 1.420 0.142 
x3 =0.3 1.362 1.620 0.162 
x, =0.4 1.524 1.924 0.1924 
x, =0.5 1.7164 2.2164 0.2216 
xe =0.6 1.9380 2.5380 0.2538 
xX, =0.7 2.1918 2.8918 0.2892 

xg =0.8 2.4810 3.2810 0.3281 
X =0.9 2.8091 3.7091 0.3709 
Xp = 1.0 3.1800 


We have found the approximate value y |p=; = 3.1800. The exact solution 
of this equation that satisfies the indicated initial conditions is 


y = 2e* —x—1 


y leet = 2 (e— 1) = 3.4366 
0.2566 
3.4366 


1.33 A DIFFERENCE METHOD FOR APPROXIMATE 
SOLUTION OF DIFFERENTIAL EQUATIONS BASED 
ON TAYLOR’S FORMULA. ADAMS METHOD 


We once again seek the solution of the equation 
y' =F (x, y) . (1) 


on the interval [x,, b], which solution satisfies the initial condi- 
tion y=y, when x=x,. We introduce notation that will be needed 
later on. The approximate values of the solution at the points 


Xos Xis Xas oee Xn 


Hence, 


The absolute error is 0.2566; the relative error is 


=0.075 x 8%. 


will be 
Yo» Yi» Yz» se ey. Yn 


The first differences, or differences of the first order, are 
AY =Yi—Yor AY = Y2— Ys» +) AYn-1 = Yn — Yn 
The second differences, or differences of the second order, are 
AP Yo = AY, — Â Yo = Ya— 244 + Yo 
A*y, = Ay,— AY, = Ys — 242 +Y 
A? Yn -2 = AYn-1— AYn-2 = Yn— 2Yn—1 +Yn-2 
Differences of the second differences are called differences of the 
third order, and so forth. We denote by yo, Yi, ..-, Yn the approx- 
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imate values of the derivatives, and by yo, yi, ..-,y, the 
approximate values of the second derivatives, etc. Similarly we 
determine the first differences of the derivatives: 


A =Y — Yo, AY =Y — Yar -s AY = Ya— Yai 
the second differences of the derivatives: 
Ay = Ayi — Ayo, A®y, = Aya — Ay, -+ +, A Yne = AYn-1 —AYn- 


and so on. 
Write Taylor’s formula for solving an equation in the neigh- 
bourhood of the point x= x, [see (6) Sec. 4.6, Vol. I]: 


cay ae —x,)? n Z 
y= yo te yt EE yt... 4 SM mR, (2) 
In this formula y, is known, and the values yj, yj, ... of the 


derivatives are found from equation (1) as follows. Putting the 
initial values x, and y, into the right side of equation (1), we 
find y: , 

Yo =e (Xos Yo) 
Differentiating the terms of (1) with respect to x, we get 


n" ð 0, r 
y =H Fy (3) 


Substituting into the right side the values x,, Y», yp, we find 


„(Aty 
n= (+3 lez =Yo. V'=Y 


Once more differentiating (3) with respect to x and substituting 
the values xo, Yo Yo Yo, We find y,’’. Continuing in this fashion, 
we can find the values of the derivatives of any order for x=x,.* 
All. terms are known, except the remainder R,, in the right side 
of (2). Thus, neglecting the remainder, we can obtain an approx- 
imation of the solution for any value of x; the accuracy will 
depend upon the quantity |x—.x,| and the number of terms in 
the expansion. 

In the method given below, we determine by formula (2) only 
the first few values of y when |x—x,| is small. We determine 
the values A and y, for x,=%)+h and for x,=x,+2h, taking 


four terms of the expansion (y, is known from the initial data): 
hoo Bon B u 

Y= Y tT Yo tTa Yt 3 Yo (4) 
2h , 2h)? s (2h? n. 

n=nt nt Y+ y (4’) 


* From now on we shall assume that the function f(x, y) is differentiable 
with respect to x and y as many times as is required by the reasoning. 
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We thus consider known three values* of the function: y,, 
Yı» Yz: On the basis of these values and using equation (l), 
we find e 


W= F (Xo Yo), y= f (Xi Y), Ya = f (Xas Y) 


Knowing, Ya, Yí, y2, it is possible to determine Ay, Ayi, Ayo. 
Tabulate the results of the computations: 


x Y | y’ | Ay’ | Ary’ 
: |» | „| | 
| | | a4 | 

aca | n [| a |e 
| | | am | 
| | ee 
Xp-a=Xyt(k—2)h | Yr-a | Yk | | 
| | | avin | 

Xk-1 = Xo +(k—!)h | YR-1 | Ypi | | Ayia 
| | | avian | 
=t |o omw o | | 


Now suppose that we know the values of the solution 


Yos Yi» Yor wees Yk 
From these values we can compute [using equation (1)] the values 
of the derivatives 
Yo» Yis Yr, eons Yk 
and, hence, 
Ayo, Ay, -- +, AY 


* If we were to seek the solution with greater accuracy, we would have 
to compute more than the first three values of y. This is dealt with in 
detail by Ya. S. Bezikovich in Approximate Calculations, Gostekhizdat, 
1949 (in Russian). 
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and : , : 

Ayo AY, -s A7Y pe 
Let us determine the value of y,,, from Taylor’s formula setting 
a= Xp, rey h: 


Yeti = =w+4+ +i tht 7. yi a Tr ayy +Rn 


In our case we shall confine ourselves to four terms of the 
expansion: 


h , re, Ba, 
Yas = Yet T Yt Ta Ye + Tag Ye (5) 


The unknowns in this formula are y and yg’, which we shall 
try to determine by using the known first and second differences. 
First, represent y., in Taylor’s formula, putting a= Xp, 
x—a=—h: 
, h) n | (—A)? oe 
Ye-1 = HAS nRT di Yk (6) 


and y,_,, putting a=x,, x—a=—2h: 
CP) 7 Cy 


Yk- (7) 
From (6) we find 
, $ , h n hs, 
Yk— Yk- = AYk-ı = -T Yk — Ta Yk (8) 
Subtracting the terms of (7) from those of (6), we get 
, , , h „n k npo 
Yk-ı — Yk- = ÅAYr— = -T Yk — y Yk (9) 
From (8) and (9) we obtain 
AYp—1 — AYk- = A Yk = hyk 
or 
sre 1 ’ 
Yk = Fr A Yk (10) 
Putting the expression yg’ into (8), we get 
„__ ÂY | AYR- 
g= + (11) 


Thus, yg and y,’’ have been found. Putting expressions (10) 
and (11) into the EPG (5), we obtain 


Yk = Yk HT Ay +t Ayk- tA (12) 


This is the so-called Adams formula with four terms. Formula 
(12) enables one to compute y,,, when Yk, Yx-1, Ye-2 are known. 
Thus, knowing y,, y, and y, we can find y, and, further y,, Ys, ... 
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Note 1. We state without proof that if there exists a unique 
solution of equation (1) on the interval [x,, b], which solution 
satisfies the initial conditions, then the error of the approximate 
values determined from formula (12) does not exceed, in absolute 
value, Mht, where M is a constant dependent on the length of 
the interval and the form of the function F (x, y) and independent 
of the magnitude of h. 

Note 2. If we want to obtain greater accuracy in our computa- 
tions, we must take more terms than in expansion (5), and for- 
mula (12) will change accordingly. For instance, if in place of 
formula (5) we take a formula containing five terms to the right, 
that is, if we complete it with a term of order A‘, then in place 
of formula (12) we, in similar fashion, get the formula 


Yaoi = Yet 7 Aye Ayia +75 Akat * AY, 5. 


Here, y,,, is determined by means of the values Yp, Yp-1, Ye—o 
and y,-,. Thus, in order to begin computation using this formula 
we must know the first four values of the solution: y,, Yi, Yo. Ys- 
When calculating these values from formulas of type (4) one 
should take five terms of the expansion. 


Example 1. Find approximate values of the solution of the equation 
y=ytx 
that satisfies the initial condition 
Yo=! when x,=0 


Determine the values of the solution for x=0.1, 0.2, 0.3, 0.4. 
Solution. First we find y, and y, using formulas (4) and (4’). From the 
equation and the initial data we get 


yo= Y+*)c=0=Yot%= 1+0=1 
Differentiating the given equation, we have 
y=y' +l 
yor ly’ + l)x=0=1-+1=2 
Differentiating once again, we get 


Hence, 


y” =y 
Hence, 


aon 


Yo =yo=2 
Substituting into (4) the values yo, yo, yo and h=0.1, we get 


01 | (0.1)? 2, Ol 
wate pO gp OU 21.1103 


Similarly, for h=0.2 we have 


(0.2)? 


0. 


24 ES : = 1.2427 
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Knowing Yo, Y1» Ya, we find (on the basis of the equation) 
Yo=Yo+ to=! 
Yy=Y1 +X, = 1.1103 +0.1 = 1.2103 
Ya = Ya + xa = 1.2427 40.2 = 1.4427 
Ayo = 0.2103 
Ay; = 0.2324 
Ayo = 0.0221 


Tabulating the values obtained, we have 


yı=1.1103 


From formula (12) we find ys: 


5-(0.1) 


Y= 1.24274 2L . 1.4427 4 St . 0.2324 -+ —5—- 0.0221 = 1.3995 


We then find the values of Ys, Ays, A*y;. Again using formula (12) we find Ye 
0.1 0.1 5 


The exact expression of the solution of the given equation is 


y= 2e —x—l 
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Hence, yx —o,4== 2e%4 —0.4— l = 1.58364. The absolute error is 0.0003; the rela- 
0. 


tive error, -5836 ae m 0,0002 = 0.02% (In Euler’s method, the absolute error 


of y, is 0.06, the relative error, 0.038 = 3.8%.) 
Example 2. Find approximate values of the solution of the equation 


y'= 
that satisfies the initial condition yy=0 for x¿=0. Determine the values of the 
solution for x=0.1, 0.2, 0.3, 0.4. 
Solution. We find 
yo = 08+ 0? =0 
Yrmo = (2yy’ + 2x), =0 
Yano = (2y'? + 2yy” +2)y29=2 
By formulas (4) and (4’) we have 


3 3 
y= .2 = 0.0003, v= 92" .2= 0.0027 


From the equation we find 
yo=0, y,=0.0100, y =0.0400 


Using these data, we construct the first rows of the table, and then deter- 
mine the values of y and y, from formula (12). 


x, =0.1 y, == 0.0003 y, =0.0100 | Ay, = 0.0200 
| | Ay; = 0.0300 | 

X_=0.2 Yz = 0.0027 | y2 = 0.0400 | A’y, = 0.0201 
| | | Ay, = 0.0501 | 

x,=0.3 Ys = 0.0090 ys = 0.0901 | | 

x, =0.4 Y4 = 0.0204 | | | 
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Thus, 
ya=0.0027 +% -0.0400 -+ 2-1. 0.0300 + 5.0.1 -0.0200 =0.0090 


ya =0.0090 +°-+.0,0901 + 9:* 0.0501 + 7, -0.1-0.0201 =0.0214 


Note that, to four places, y,=0.0213. (This may be obtained by other, more 
precise, methods with error estimation.) 


1.34 AN APPROXIMATE METHOD FOR INTEGRATING SYSTEMS 
OF FIRST-ORDER DIFFERENTIAL EQUATIONS 


The methods of approximate integration of differential equa- 
tions considered in Secs. 1.32 and 1.33 are also applicable for 
solving systems of first-order differential equations. Here, 
we consider the difference method for solving systems of equa- 
tions. We will be concerned with systems of two equations in 
two unknown functions. 

It is required to find the solutions of a system of equations 


Uj, (x, y, 2) (1) 


a= f(X, y, 2) (2) 


that satisfy the initial conditions y = 4, z=-z, when x=x,. 
We determine the values of the functions y and z for values of 
the argument x,, Xis Xas -++ Xs Xk+ +++» Xn. Again, let 


Xpay—Xp=Ax=h (k=0,1,2,...,n—!l) (3) 


We denote the approximate values of the functions y and z, respec- 
tively, by 
Yo» yy wey Yrs Gets eee, Yn 


and 
Zo Za ee Zkari oe ea Se 
Write the recurrence formulas of type (12), Sec. 1.33: 
h, h ’ 5 , 
Yat = Yr t T Yet y Ak- + 75 MA Yes (4) 
h , h ’ o 
Zeer tat tet i Ak- + jahit (5) 


To begin computations using these formulas we must know y,, Yz; 
2,, 2, in addition to y, and z,; we find these values from formu- 
las of type (4) and (4°), Sec. 1.33: 


h o, A, BB ,,, 
Yı =Y t T Ho t p Yot a Yo 
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2h , 2h)? | (2h)? 3, 
nant nt E yut y 
h , hR „n , he ,,, 
21 = 2% +T 2 + | 2% + ay 20 
2h, (2h)? (2h)? s, 


22= Z2 +T otg ot g o 


To apply these formulas, one has to know yo, Yg, yo’, 20, 2%, 


r’ 


2), which we shall now determine. From (1) and (2) we find 


Yo A hi (Xo, Yo. Zo) 
zo = fa (Xor Yor Zo) 
Differentiating (1) and (2) and substituting the values of x, y,, 20s 
yo and z2, we fin Ses, p 
Y= (y")x=x, = (3 + oh y + oh » Vi 


y 
fs , Fs 


n= (Zeon =(Ft4 Fey 42") 
Ox oy Oz [X=Xq 


$ 


Differentiating once again, we find yọ” and z,'. Knowing y,, Ya, 


Zi» 2,, we find from the given equations (1) and (2), 
Yis Yes Zis Zg Ayo Ay, Ayo, Az, Az, A2z, 
after which we can fill in the first five rows of the table: 
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From formulas (4) and (5) we find y, and z,, and from equa- 
tions (1) and (2) we find y, and z;. Computing Ay;, A?y,, Az;, A?z;, 
we find y, and z, etc., by applying formulas (4) and (5) once 
again. 

Example. Approximate the solutions of the system 

=z, z' =y 
with initial conditions yọ=0 and zọ=1 for x=0. Compute the values of the 


solutions for x=0, 0.1, 0.2, 0.3, 0.4. 
Solution. From the given equations, we find 


Yo=2x-0=! 
Zo=Yx=0=0 


Differentiating the given equations, we find 


Yo =(Y")x=0= (2') x20 =0 
z0= (2" )x=0= (Y')x=0=1 
yo “= (y" Ven o= (2")x=0=1 
zo = (2" ‘\x=0= (¥") x50 == 


Using formulas of type (4) and (5), we find 


(0. 5 t- da 


2 n=04+% i L£ 0+! =0.1002 
n=04+%. 1462 a 5 0.2 23 -1=0.2013 
peace’ a 9 pO) f ape A 0= 1.0050 
a=14%. A 2, pee 2p -0 = 1.0200 
Using the given equations, we find 
yi = 1.0050, zí = 0.1002 
y2= 1.0200, 29 = 0.2013 


Ayo =0.0050, Azo = 0.1002 
Ay; = 0.0150, Az, =0.1011 
A?yo =0.0100,  A?zo = 0.0009 


and fill in the first five rows of the table (see p. 145). 
From formulas (4) and (5) we find 


y; =0. 201321. l. 0200 +91. 0.0150 +3. -0.1-0.0100 = 0.3045 


zg= 1. 0200+24. -0.2013 PAL 0.1011 +5: -0.1-0.0009 = 1.0452 


X_ == 0.2 Za = 1.0200 z, = 0.2013 A3z; = 0.0021 


Az; = 0.1032 | 


’ 


X3=0.3 Z == 1.0452 z4 = 0.3045 


| | 
x,=0.4 24 == 1.0809 | | | 


10.—2082 
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and similarly 


y= 0.305424, 1.0452 +51 0.0282 ae 1-0.0102 = 0.4107 
a=! 0452424. 0.3045 + 1. -0. 1032 + 2. 0.1-0.0021 = 1.0809 
It is obvious that the exact solutions of the system of equations (the solu- 
tions satisfying the initial conditions) will be 
y=sinh x, z= cosh x 
And so, solutions correct to the fifth decimal place are 
y,=sinh 0.4 = 0.41075, z= cosh 0.4 = 1.08107 
Note. Since higher-order equations and systems of equations in 


many cases reduce to a system of first-order equations, the meth- 
od given above is applicable to the solution of such problems. 
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Show that the indicated functions, which depend on arbitrary constants, 
satisfy the corresponding differential equations: 


Functions Differential Equations 
d 1 
rasa -sinx ay NLE 
1. y=sinx—1+Ce ; aT! cos t=5 sin 2x. 
2. y=Cx+C—C?, (Z) -2- f=. 
dy \2 di 
3. P =2Cx +0, s(Z) +- 
_ aC dy\?) _ 22 92) Y 
4. yi=C— TGs xy [1- (3) |= y a Fre 
C & 3 d? 
ae ae ate a” 
d? 
6. y= (Cr+ Car) s + g rr T’ £4 Yy bry met, 
7. y = Cyet aresin ¥4 Cye~4 arcsin x | (124) dy YW gay = 0. 
_ C dy , 2 om 
me aso ate a? 


Integrate the differential equations with variables separable: 

9. ydx—xdy=0. Ans. y=Cx. 10. (we Ge eee Ans. 
hua 0c 11. (i+ y)dx—(l—x)dy=0. Ans. (1+y)(l—x)=C 
12, (at) Etto. Ans. EF +n ŽC. 18. fia) de iya 

1 
Ans. (y—a}=Ce*. 14. zdt—(t®—ał)dz=0. Ans. Sel". ise 

. (y = . 14. ; : Tra dy 

1+x? 


2) dt — V Tds = : t— 
Tage: Ans. Cy" 16. (1-++s?)dt— Ytds=0. Ans. 2 VT 
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—arctans=C. 17. dp+ptan@d0=0. Ans. p=Ccos@. 18. sin @ cos p dé — 
— cos 6sin gdp=0. Ans. cos p=C cos 8. 19. sec? 0 tan p dð + sec? ọ tan 8 dp—0. 
Ans. tanOtang=C. 20. sec? @tangdp-+sec? ptan6d@=0. Ans. sin? 6+ 


+sin?g=C. 21. (1L+x*)dy—Vl—y?dx=0. Ans. arcsin y—arctanx-=C. 
22, Vi—x®* dy— V 1l—y? dx=0 Ans. o g I—x?— x V l— y? =C. 
23. 3e* tan y dx + (1 —e*) sec? y dy =0. Ans. tan y =C (1 —e*)3. 24. (x— y?x) dx+ 
+ (y—x?y) dy =0. Ans. x? + y? =x?y? +C. 


Problems in Setting up Differential Equations 


25. Prove that a curve having the slope of the tangent to any point propor- 
tional to the abscissa of the point of tangency is a parabola. Ans. y =ax? +C. 

26. Find a curve passing through the point (0, —2) such that the slope of 
the tangent at any point of it is equal to the ordinate of this point increased by 
three units. Ans. y=e* —3. 

27. Find a curve passing through the point (1, 1) so that the slope of the 
tangent to the curve at any point is proportional to the square of the ordinate 
of this point. Ans. k(x—1)y—y+1=0. 

28. Find a curve for which the slope of the tangent at any point is n times 
the slope of a straight line connecting this point with the origin. Ans. y=Cx". 

29. Through the point (2, 1) draw a curve for which the tangent at any 
point coincides with the direction of the radius vector drawn from the origin 


to the same point. Ans. y=4e. 


30. In polar coordinates, find the equation of a curve at each point of 
which the tangent of the angle between the radius vector and the tangent line 
is ure ‘to the reciprocal of the radius vector with sign reversed. Ans. 
r(0+C)=1. 

31. In polar coordinates, find the equation of a curve at each point of which 
the tangent of the angle formed by the radius vector and the tangent line is 
equal to the square of the radius vector. Ans. r?=2(0+C). 

32. Prove that a curve with the property that all its normals pass through 
a constant point is a circle. 

33. Find a curve such that at each point of it the length of the subtangent 
is equal to the doubled abscissa. Ans. y=CY x. 

34. Find a curve for which the radius vector is equal to the length of the 
tangent between the point of tangency and the x-axis. 


|V y?= Vit+y?, whence $a4% 


Solution. By hypothesis, ra 


Y 
y' 


Integrating, we get two families of curves: y=Cx and v= 


35. By Newton’s law, the rate of cooling of some body in air is proportional 
to the difference between the temperature of the body and the temperature ot 
the air. If the temperature of the air is 20°C and the body cools for 20 mi- 
nutes from 100° to 60°C, how long will it take for its temperature to drop 
to 30°C? 

dT 


Solution. The differential equation of the problem is ap ~ (T —20). Inte- 


grating we find: T—20—Cekt; T= 100 when ¢=0, T=60 when ¢ =20; there- 


1 t 
fore, C=80, 40=Ce20k, a=); consequently, 7 =20-480( 7)”. 


Assuming T =30, we find ¢=60 min. 
36. During what time T will the water flow out of an opening 0.5cm? at 
the bottom of a conic funnel 10cm high with the vertex angle d=60°? 
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Solution. In two ways we calculate the volume of water that will flow out 
during the time between the instants ¢ and £- At. Given a constant rate v, 
during 1 sec a cylinder of water with base 0.5 cm? and altitude h flows out, 
and during time A? the outflow is the volume of water du equal to 


—dv = — 0.5 v dt = — 0.3 VW 2ghat* 


On the other hand, due to the outflow, the height of the water receives 
a negative “increment” dh, and the differential of the volume of water out- 
flow is 


—dv= artdh= = (h+0,7} dh 
Thus, 
z (h-+0.7)2dh = — 0.3 V 2gh dt 
whence 
t = 0.0315 (10°/s— p°/2) + 0.0732 (10°/# —n*/#) +.0.078 ( V 10— V h) 


Setting h=0, we get the time of outflow T = 12.5 sec. 

37, The retarding action of friction on a disk rotating in a liquid is pro- 
portional to the angular velocity of rotation w. Find the dependence of this 
angular velocity on the time if it is known that the disk begins rotating at 
100 revolutions per minute and, after the elapse of one minute, rotates at 


t 
60 revolutions per minute. Ans. w= 100 ($) rpm. 


38. Suppose that in a vertical column of air the pressure,at each level is 
due to the pressure of the above-lying layers. Find the dependence of the pres- 
sure on the height if it is known that at sea level this pressure is 1 kg per cm?, 
while at 500 m above sea level it is 0.92 kg per cm?. 

Hint. Take advantage of the Boyle-Mariotte law, by virtue of which the 
density of a gas is proportional to the pressure. The diferential equation of 
the problem is dp=— kpdh, whence p=e~9-90017h Ans. p=e7000017h, 

Integrate the following homogeneous differential equations: 

39. (y —x) dx+ (y + x) dy =0. Ans. y? +-2xy — x? =C. 40. (x+ y) dx + x dy =0. 
Ans. x*+2xy=C. 4l. (x+y)dx+(y—x)dy=0. Ans. In(x2+y3)""— 


— arctan fc. 42. xdy—ydx= Vx? F y7 dx. Ans. 14+2Cy—C%x?=0. 
43. (8y + 10x) dx + (5y + 7x) dy =0. Ans. (x+ y)? (2x + y} =C. 44. (2 V st —s) dt+ 
sS 


+tds=0. Ans. te TC or sat int Ê, 45. (t—s)dt+tds=0. Ans. 
sS 


tef =C or s=tln E, 46. xy? dy=(® +y") dx. Ans. y =x%/ 3 in Cx. 


47. x cos 2 (y dx + x dy) = y sin 4 (x dy—ydx). Ans. xy cos: =. 


Integrate the differential equations that lead to homogeneous equations: 
48. (3y —7x +7) dx—(3x—7y—3)dy=0. Ans. (x+ y— 1) (x—y—1} =C. 
49. (x+-2y + 1) dx—(2x-+4y+3)dy=0. Ans. In(4x+8y+5)+8y—4x=C. 


BO. (x+ 2y + 1) dx—(2x—3) dy=0. Ans. In (2x—3)— tS =C, 


* The rate of outflow v of water from an opening a distance h from the 


free surface is given by the formula v=0.6 V 2gh, where g is the acceleration 
of gravity. 
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51. Determine the curve whose subnormal is the arithmetic mean between 
the abscissa and the ordinate. Ans. (x— y)? (x+ 2y)= 

52. Determine the curve in which the ratio of the y-intercept of the tangent 
to the radius vector is equal to a constant. e 


y=% 
Solution. By hypothesis, a= whence ( =)" -( F)" =% 


53. Determine the curve in Ga the ratio of the x-intercept of the normal 
to the radius vector is equal to a constant. 


Solution. It is given that =m, whence x? + y? =m? (x —C)?. 


Very 

54. Determine the curve in which the y-intercept of the tangent line is 
equal toasec 0, where @ is the angle between the radius vector and the 
x-axis. 


Solution. Since tan o=4 and by hypothesis 


dy _ 
y—x jy asec 0 
we obtain 
dy Vx 
YX ie x 
whence 


55. Determine the curve for which the y-intercept of the normal drawn to 
some point of the curve is equal to the distance of this point from the origin. 


Solution. The y-intercept of the normal is yt therefore, by hypothesis, 
we have 
yt a= yV x? +y? 
whence 
x? =C (2y +C) 


56. Find the shape of a mirror such that all rays emerging from a single 
point O are reflected parallel to the given direction. 

Solution. For the x-axis we take the given direction, O is the origin. Let 
OM be the incident ray, MP the reflected ray, and MQ the normal to the 
desired curve: 


a=, OM=0Q, NM=y 
NQ=N0+0Q=— x+ VEF =y cot B= y 2 
whence 
y dy=(—x+ Vxt-y) dx 


y2=C?+2Cx 
Integrate the following linear differential equations: 


Integrating, we have 
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57. y —— =(x+ 1). Ans. 2y=(x+1)1+C (x+ 1%. 58. y’—a 4=* ma, 


zH x 
Ans. y=Cxtt—~ aa 59. (x — x3) y’ + (2x?— 1) y—ax8=0. Ans. y=ax+ 


+ CxV 1— x. 60. T cos t-+ssin t= 1. Ans. s= sin t +C cost. 61. E 4s cos f= 


= 5 sin 2t. Ans. s=sin £+—1-+Ce ~ "t, 62. y’ -2 y=e%x", Ans. y==x" (e*+-C). 


1 
63. v+Žs=5. Ans. x"y=ax+C. 64. y+y=5- Ans. exy=x-+C. 


,, 1—2x x 
65. y'+ a y—1=0. Ans. y=x?\14+Ce j}. 
Integrate the Bernoulli caeet one: 
66. y’ -+- xy =x3y3. Ans. y Rags eae eri 67. (1 — x?) y’ — xy — axy? = 0. 
Ans. (CV 1—x?—ayy=1. 68. 3y?y'—ay?—x—l=0. Ans. ay’ = Cea* — 


E £ 
—a(x+l)—l. 69. y’ (x8y3+xy)=1. Ans. x |(2— we! Pacl- 
70. (gin 2 2) yd = dy. Ans. y(Cx?+Inx?+1)=4. 71. y— pee 
2 2 tan x+ sec x 
= y? cos x (1 — sin x). Ans. s=- inr 


Integrate the following exact differential Aaa 
72. (x234 y)dx+ (x—2y)dy=0. Ans. Z pyx y?=C. 73. (y—3x?) dx — 
a ey Ans. 2y?—xy+x=C. i. (y3—x) y' =y. Ans. y4=4xy+C. 
y 1 yy 
75. aes dx+ |— 3|dy= 0. Ans. reer oles 


(x—y)? x (x—y)? 
76. 2 (3xy? + 2x3) dx + (ty y ) dy = = Ans. x4 ety? ty = C. 


xdx+(2x+y)dy _ 3y? 2y dy 
77 ete ay it = 78. (+e a= p 
x? dy — y? dx 
Ans. x?-++y2=Cx8. 79. Gap =. Ans. pg 80. xdx+ y dy = 


= ea Ans. x*-+ y?—2 arctan S=C. 

81. Determine the curve that has the property that the product of the square 
of the distance of any point of it from the origin into the x-intercept of the 
normal at this point is equal to the cube of the abscissa of this point. Ans. 

a (2p) =C 
Á 82. Find the pba oe of the following families of lines: (a) y = Cx + C?. 
Ans. x?+4y=0. (b) y=ž+40. Ans. 27x? = 4y’. (c) 4-&=2 Ans. 27y = x3. 
(d) C?x+Cy—1=0. ae y?+4x=0. (e) (x—C)8+ (y—C)?=C?. Ans. x=0, 
y=0. (Í) kO ty 3=—4C. Ans. y2=4x+4. (g) (x—C)?+(y—0C)}=4. Ans. 
te—y)*=8. (h) Ct toy=i. Ans. x4+ 4y=0. 

83. A straight line is in motion so that the sum of the segments it cuts off 
on the axes is a constant a. Form the equetion of the envelope of all positions 
of the straight line. Ans. xlety Va q'/s (parabola). 

84. Find the envelope of a family of straight lines = which the coordinate 


axes cut off a segment of constant length a. Ans. x° +y T at 
85. Find the envelope of a family of circles whose diameters an the doubled 


ordinates of the parabola y2=2px. Ans. y? = 2p (x+4) 
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86. Find the envelope of a family of circles whose centres lie on the para- 
bola y2=2px; all the circles of the family pass through the vertex of this 
parabola. Ans. The cissoid 43+ y? (x+ p)=0. 

87. Find the envelope of a family of aircles whase diameters are 
chords of the ellipse 52x*-+-a2y2— ab? perpendicular to the x-axis. Ans. 


x? y 
a? + b? ta= x 
88. Find the evolute of the ellipse b?x? 4- a?y? = a?b? as the envelope of its 
2 


normals. Ans. (ax)'/+ + (by)*/s = (a? — b?) ? . 
Integrate the following equations (Lagrange equations): 
C 2 2C — p® 
A , 12 PEAR ne pce =, 
89. y =2xy' +y”. Ans. =F zP y 3p 
90. y=xy° +y”. Ans. y=(Vx¥i+C)?. Singular solution: y=0. 
91. y=x(1+y)+ (y). Ans. x=Ce~P—2p+2, y=C(p+1)e-P—p?+2 
92. y=yy'*+2xy’. Ans. 4Cx=4C?—y?. 93. Find a curve with constant nor- 
mal. Ans. (x—C)?-+ y? =a?. Singular solution: y= + a. 
Integrate the given Clairaut equations: 
94. y=xy'’+y'—y". Ans. y=Cx+C—C?. Singular solution: 4y -== (x+ 1). 
95. y=xy' + V1l—y”. Ans. y=Cx+ V 1—C?. Singular solution: y2—x?=1. 


96. y=xy’+y’. Ans. y=Cx+C. 97. yaa +o. Ans. y=Cx +4 Singular 


solution: y?=4x. 98. y=x ots Ans. y=Cx—4. Singular solution: 
y 


vn, Le 8! 
4 
99. The area of a triangle formed by the tangent to the sought-for curve 
and the coordinate axes is a constant. Find the curve. Ans. The equilateral 
hyperbola 4xy = + a?. Also, any straight line of the family y=Cx +aVC. 
100. Find a curve such that the segment of its tangent between the coordi- 


nate axes is of constant length a. Ans. y=Cx+ eee Singular solution: 


Vi-c? 
x "Js ty! =a’ls, 
101. Find a curve the tangents to which form, on the axes, segments whose 


sum is 2a. Ans. y=Cx— Oe 

102. Find curves for which the product of the distance of any tangent line 
to two given points is constant. Ans. Ellipses and hyperbolas. (Orthogonal and 
isogonal trajectories.) 

EA the orthogonal trajectories of the family of curves y=ax". Ans. 
xt+ny=C. 

104, Find the orthogonal trajectories of the family of parabolas y? = 2p (x — a) 


x 


. Singular solution: (y — x — 2a)? = 8ax. 


(a is the parameter of the family). Ans. y=Ce P. 
105. Find the orthogonal trajectories of the family of curves x?—y?=a 


(a is the parameter). Ans. y=<. 
106. Find the orthogonal trajectories of the family of circles x?-+ y?=2ax. 
Ans. Circles: y =C (x?+ y?). 


107. Find the orthogonal trajectories of equal parabolas tangent at the vertex 
of the given straight line. Ans. If 2p is the parameter of the parabolas and the 
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given straight line is the y-axis, then the equation of the trajectory will be 


3 
_2 2 7 
s+c=3 V Ze. 


108. Find the orthogonal trajectories of the cissoids y?= 
(+ y9? =C (y3 2x). 

108. Find the orthogonal trajectories of the lemniscates (x? -+- y2)? = (x? — y?) a2. 
Ans. (x®-+ y?)?=Cxy. 

110. Find the izogonal trajectories of the family of curves: x? = 2a (y—x V 3), 
where a is a variable parameter if the constant angle formed by the trajectories 
and the lines of the family is œ= 60°. 


Solution. We find the differential equation of the family y=% V3 and 


Ans. 


2a — 


for y’ substitute the expression = If w=60°, then 3 
and we get the differential equation YA-V3_ V 3. The complete in- 
I+y'V3 * 


tegral y2=C (x—yV 3) yields the desired family of trajectories. 
111. Find the isogonal trajectories of the family of parabolas y2=4Cx when 


5 arctan 24 = 
w= 45°. Ans. y2—xy + 2x? = Ce" 7 svT, 


112. Find the isogonal trajectories of the family of straight lines y=Cx for 
2V3 arctan 2 


2L y3 = 
the case w =30°, 45°. Ans. The logarithmic spirals P+ =e 


2 arctan £ 
x 


XL+ ye 

113. da Ra Eliminate C, and Ca. Ans. y”—y=0. 
114. Write the differential equation of all ‘circles lying in one plane. 
Ans. (1 +y) y” —3y'y"=0. 

115. Write the differential equation of all central quadric curves whose prin- 
cipal axes coincide with the x-and y-axes. Ans. x(yy" +- y°)— y'y=0. 

116. Given the differential equation y’’’—2y”—y’+2y=-0 and its general 
solution y=Cy,e* + C,e—* + Cge?*. 

It is required to: (1) verify that the given family of curves is indeed the 
general solution; (2) find a particular solution if for x=0 we have y=1, y’=0, 


y’=—1. Ans. y= q (Wer 4e- — det, 


117. Given the differential equation y”= and its general solution 


a 
2y’ 
2 8 
y= tz C+C)’ +C. 
It is required to: (1) verify that the given family of curves is indeed the 


general solution; (2) find the integral curve passing through the point (1, 2) if 
the tangent at this point forms with the positive x-axis an angle of 45°. Ans. 


2573, 4 
y=5 Vety. 
Integrate some of the simpler types of differential equations of the second 
order that lead to first-order equations. 


118. xy” =2. Ans. y =x? ln x-+Cyx?+C,x-+Cs; pick out a particular solu- 
tion that satisfies the following initial conditions: x=1, y=1, y’=1, y"=3, 
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Ans. y=x? lnx +1. 119. yo) =x", Ans. y= St Cyt... + Cai yet 
+6). o. y” =aty, Ans. ax=ln (ay 4- Vaty?$C,)-+C, or y=C es +Cye- 2%, 
121. y" =a" Ans. (Cix +C)? =C? —a. 


In Nos. 122-125 pick out a ae solution that satisfies the following 
initial conditions: x=0, y= —1, y'= 


122. xy”—y'’ =x*%e*. Ans. R ea ee ae aan Particular solution: 
y =e* (x—1). 123. yy”—(y'} + (y')5=0. Ans. y+C,Iny=x+Cy. Particular 


solution: y=— 1. 124. y”-+y' tan x=sin 2x. Ans. y= =Cy}C, sin x—x— -ysin 2x. 


Particular solution: y= 2 sin x—sin x cosx—x— 1. 125. (y")?+(y’)?=a?. Ans. 
y=C,—a cos (x+C,). Particular solutions: y=a— l —a cos x, y=a cos x— (a+ 1). 


(Hint. Parametric form: y”=acost, y’=asint.) 126. y” = Ans. y= 


2y' ` 
2 
=+ F +C)? +Cy. 127. y'"' =y”. Ans. y=(C1—x) [In (Cy —x)— 1]+Cex+C3. 
128. y’y’’—3y""=0. Ans. x=C,y2?+Cey + C3. 
Integrate the following linear differential equations with constant coefficients: 
129. y”=9y. Ans. y= C,e°* +C,e-3*. 130. y”+y=0. Ans. y= A cos x + 
+Bsinx. 131. y”—y'=0. Ans. y=C,+Cye*. 132. y”+12y=7y’. Ans. 
y = Cye®* + Cet. 133. y”— 4y' +4y=0. Ans. y =(C1 +Cax) e**. 134. bay" 
+10y=0. Ans. y=e-*(Acos3x+Bsin3x). 135. y”-+3y’—2y=0.° Ans 
-3+ Y7, -3- viz, 3x 


y=Ce ? +C ? . 136. 4y” — 12y'+9y=0. Ans. y=(C1ı+C2x%) e?. 


->x V3 
137. y’+y’+y=0. Ans. y=e 2 [4 cos (Ya +8 sin ¥3,) 
138. Two identical loads are suspended from the end of a spring. Find the 


motion imparted to one load if the other breaks loose. Ans. x =a cos Zs) , 
where a is the increase in length of the spring under the action of one load at 
rest. 

139. A material point of mass m is attracted by each of two centres with a 
force proportional to the distance. The factor of proportionality is k. The 
distance between the centres is 2c. At the initial instant the point lies on the 
line connecting the centres at a distance a from the middle. The initial velocity 


is zero. Find the law of motion of the point. Ans. x=a cos ( y= t). 


140. y!Y —5y"+4y=0. Ans. y=Cyex+Cye-*+4+Cye**+C,e-2*. 141. y” —2y"— 
—y'+2y=0. Ans. y= C1e?* +- Cae* ee oe 142. y” —3ay” + 3aty’ —a?y =0. 
Ans. y=(C,+Cox+Cgx2) eax. 143. yV—4y'" =0. Ans. y =C; + Cox + Cox? 
+C4e2*+Cye-2*. 144. y! V +2y"+9y=0. Ans. y=(C, cos V 2x-+C, sin V 2x) e~*+ 
+ (Cs cos V2x-+C,sin V2x)e*. 145. y!V—8y"+16y=0. Ans. y=C,e*4+ 

x 


+ Cye-2* 4+ Cyxe®* t- Cyxe-2*, 146. y!Y +y=0. Ans. y= 3(Cy cos Zo 


V2 
+ C, sin— v3) + ev? (6 cos Wa +C, sin —— V3 7a): 


147. y! V —aty=0. Find the general solution and pick out a particular 
solution that satisfies the initial conditions for x,=0, y=1, y’=0, y= — 8, 
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“"" =0. Ans. General solution: y=C ,e2* + Cae- ax + Cs cos ax+C, sin ax. Parti- 
cular solution: y= cos ax. 
Integrate the following nonhomogeneous linear differential equations (find the 
general solution): 
12x +7 


148. y”—7y' + 12y=x. Ans. y=Cy,e5* + Cet% + 144 
Ans. s=Cyeet 4 Cye- at EEL, 150. y”-+y’—2y=8sin 2x. Ans. y=Cye*+ 


. 149, s*—a’s = t+1. 


+C- — E (6 sin 2x -+2 cos 2x). 151. y”— y =5x+2. Ans. y=C,e* +C-*— 
—5x—2. 152. ”—?2as'+a@s=¢t (a £1). Ans. ae A E Gale rir 

153. y” +6y' + 5y=e2*. Ans. F g 154. y" + 9y =68*. 
Ans. y =C; cos 3x + Ce sin zty ex. 155. y” —3y’=2 —6x. Ans. y=C,+C,e8*+ 


+x2, 156. y”—2y'+3y =e-* cosx. Ans. y=e*(Acos V 2x+ Bsin V 2x)+ 
-x 
+ (5cos x—4 sin x). 157. y’+4y=2 sin 2x. Ans. y= A sin 2x + B cos 2x— 


-4 cos 2x. 158. y'”—4y" + 5y'—2y=2x+3. Ans. y= (C+ Cex) e” + Cpe?” — 
—x—4. 159. y!V —aty=5atee* sinar. Ans. y=(C,—sin ax) eax + Ce- ox 
+C, cos ax+C, sin ax. 160. y! V +2a?y"+aty=8 cos ax. Ans. y=(C,+C x) cos ax+- 
+ (C3+C,x) sin ax— =; cos ax. 


161. Find the integral curve of the “at uation Vita 0 that pas through 
the point M (xo, Yo), and is tangent at the point M to the straight line y =ax. 


Ans. y= Yo cos k (x— xo) + $ sin k (x— xo). 

162. Find a solution of the equation y”-+ 2hy'-4 n?y=0 that satisfies the 
conditions y =a, y' =C when x=0. Ans. For h< n y= eh(a cos Vn?— hix+ 
C +ah 


trer a sin VF: for h=n, y=e-"*((C+ah)x+a]; for h>n, 
n— 
_C+a(ht VR) | (n-vieaat) x_C+a(h— VR) (Vi) x 


2 Vat —n? 2 Vh—n? 
163. Find a solution of the equation y”-++n®y=hAsin px (p Æ n) that satisfies 


2 2) — 
the conditions: y =a, y’ =C for x=0. Ans. y=acos nx eae sin nx + 
+ 


z sin px. 
ni— 
164. K: load weighing 4 kg is suspended from a spring and increases the length 
of the spring by 1 cm. Find the law of motion of the load if we assume that 
the upper end of the spring performs harmonic oscillations under the law 
y=sin V'i00 gt, where y is measured vertically. 

Solution. Denoting by x the vertical coordinate of the load reckoned from the 
position of rest, we have a 

4 dx 


ga 
where l is the length of the spring in the free state and k= 400, as is evident 


—k(x—y—l) 
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from the initial conditions. Whence Se +100gx= 100g sin V 100 gt+100 lg. We 
must seek the particular integral of this equation, in the form 


t (C, cos V 100g t +C, sin V100g t) + 1 


snes the first term on the right enters into the solution of the homogeneous 
equation. 
165. In Problem 139, the initial velocity is vg and the direction is perpendi- 
cular to the straight line connecting the centres. Find the trajectories. 
Solution. If for the origin we take the mid-point between the centres, the 
differential equations of motion will be 


dx dy 
The initial data for ¢=0 are 
= dx _ = dy _ 
Bate: g ee eee 


Integrating, we find 


x=a cos ( y= 1) = y: sin ( yt 1) 
= mij #5 2k m 
2 2 
Whence £ ee (ellipse). 
@ mè 


166. A horizontal tube is in rotation about a vertical axis with constant 
angular velocity w. A sphere inside the tube slides along it without friction. 
Find the law of motion of the sphere if at the initial instant it lies on the axis 
of rotation and has velocity vọ (along the tube). 


2 
Hint. The differential equation of motiun is Gao, The initial data are: 
r=0, fan for ¢=0. Integrating, we find 


— 40 foot ,-of 
"= Deo [ee] 
Applying the method of variation of parameters, integrate the following diffe- 


rential equations: 
167. y”—7y'+6y=sin x. Ans. y= Cer 4 Cpe 4560 si 


168. y”-+-y==secx. Ans. y =C; cos x+C, sin x+ xsin x+<os x In cos x. 
169. y” -+ y= ——— m. Ans. y =C; cos x+C, sin x— V cos 2x. 
vty cos 2x V cos 2x i 1 S 
Integrate the following systems of equations: 
170. S =y, art. Pick out the particular solutions that satisfy 


the initial conditions x=—2, y=0 for t=0. Ans. y=C,et+C,e-'—1, 
x= C,et—Cye-*—1. Particular solution: x* = —e-t—1, y*=e-t—1. 


171. ty Wn ey, Pick out the particular solutions that satisfy 


the initial conditions: x=1!, y=1 for t=0. Ans. y=C,cos¢+C, sin?, 
x= (Cı + Ce) cost+(C,—C,)sin¢. Particular solution; «x*= cos ł—sin ¢, 
y*= cost. 
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172. 


173. 


174. 


175. 


176. 


178. 


179. 


180. 


1%- ay +3x=sin ¢ 
Ft y=cost 
Choe Ans. 
d?x 
a4 


Ch. 1. Differential Equations 


An. 


a 


dz 
ae zs cos x. 


Ans. 


dy = 
de toy te=sin x Ans. 


Ans. 


Ans. 


Ans. x= Cye-t*+C,e-3t 
y=Cye-t+ 3C,e-3t 4 cos t. 


x=Cyet-+Cye-t+C, cos #+C, sin £, 
y=Cyet+Cye~*—C, cos¢—Cysint, 


-*=C, +C +O Ete, 


y=Cy— (C1 +203) t~; (Cy—1) t= 


1 1 
La — {4_ et 
3 CP + aq! et. 


. y=(C1 + Cax) e- 3%, 


z= (Cy —C, — Cox) e73, 


y =C,e?* + Cye-2* 
z=—2 (C,e?*—C,e~2*) . 


y=C,+C,x+2 sin x, 
z= — 2C, — C, (2x+ 1)—3 sin x— 2 cos x. 


x= Cye- t + Cet, 


y=Cye-t+Cye*t, 
z= — (C,-+C5) e-t-+ Ct, 


z=CeG*, 


1 


e-C*, 
Ct; 


y=x+ 


z 3 
. yaer 79 — > x?=C,. 
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Integrate the following different types of equations: 
2dy — y? 
181. yy” =y'?+ 1. Ans. v= [eci (¥- Ca) + e-C,'*—Ca"], 182. ies! a ek Ld 
1 


Ans. rge 183. y=xy?+y". Ans. y=(Vx3-1+C)#. Singular solutions: 


y=0, x+1=0. 184. y"+y=secx. Ans. y =C, cos x +C sin x+ x sin x+ 
+cosxincosx. 185. (I-+x%)y’—xy—a=0. Ans. y=axt+C VY 14x, 
y dy y 


sin — 
= = — 1] k. . T . . ”— = e2x . n 
186. x cos eae y cos x x. Ans. xe C. 187. y”— 4y =e?* sin 2x. Ans 


2 
y= Cye-** + Creèt — (sin 2x-+ 2.008 2x). 188. xy’4-y—y®Inx=0. Ans. 


(Inx+1+Cx)y=1. 189. (2x-+2y—1)dx+(x+y—2)dy=0. Ans. 2x+y— 
— 31n PEUT: 190. 3e* tan y dx + (1! —e*¥) sec? y dy =0. Ans. tany= 
=C (I —e*)?. 

Investigate and determine whether the solution x=0, y =0 is stable for 
the following systerns of differential equations: 


Zox 3y 

191. Ans. Unstable. 
d 5r by 
dt 
4—0 

192. Ans. Stable. 
dY yoy 
dt f 
Of = 12e-+ 18y 

193. Ans. Unstable. 
Wery. 


194. Approximate the solution of the equation y'=y2+x that satisfies the 
initial condition y=1 when x=0. Find the values of the solution for x equal 
to 0.1, 0.2, 0.3, 0.4, 0.5. Ans. y x=0.5 = 2.235. 

195. Approximate the value of yx1.4 Of a solution of the equation y'+ 


tiy=e that satisfies the initial conditions y=1 when x=1. Compare the 


result obtained with the exact solution. 

196. Find the approximate values of xt=1.4 and Yt=1.4 of the solutions of 
a system of equations Foys, ty x By that satisfy the initial condi- 
tions x=0, y=1 when ¢=1. Compare the values obtained with the exact 
values. 


CHAPTER 2 


MULTIPLE INTEGRALS 


2.1 DOUBLE INTEGRALS 


In an xy-plane we consider a closed* domain D bounded by a 
line L. 
In D let there be given a continuous function 


z=f(x, y) 
Using arbitrary lines we divide the domain D into n parts 
As,, As,, Ass, ..., As, 


(Fig. 43) which we shall call subdomains. So as not to introduce 
new symbols we will denote by As,, ..., As, both the subdomains 
and their areas. In each subdomain As; (it is immaterial whether 
in the interior or on the boundary) take a 
point P;; we will then have n points: 


Pi cP iy Ph 


We denote by f(P,), f(P.), .--, f(P,) the 
values of the functions at the chosen points 
and then form the sum of the products 
F(P;) As;: 


V,=T (Py) As, +f (P.) As,+... +f (Pr) As, 
= 3 HP) As, (1) 


This is the integral sum of the function 
f(x, y) in the domain D. 

If f>0 in D, then each term f(P,) As; may be represented 
geometrically as the volume of a small cylinder with base As; 
and altitude f(P,). 

The sum V, is the sum of the volumes of the indicated ele- 
mentary cylinders, that is, the volume of a certain “step-like” 
solid (Fig. 44). 


Fig. 43 


* A domain D is called closed if it is bounded by a closed line, and the 
points lying on the boundary are considered as belonging to D. 
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Consider an arbitrary sequence of integral sums formed by 
means of the function f(x, y) for the given domain D, 


Vig Viera Ve tan (2) 


for different ways of partitioning D into subdomains As,. We shall 
assume that the maximum diameter of the subdomains As; approach- 
es zero as nęą— œo. Then the following proposition, which we 
give without proof, holds true. 


Fig. 45 


Theorem 1. /f a function f(x, y) is continuous in a closed domain 
D, then the sequence (2) of integral sums (1) has a limit if the 
maximum diameter of the subdomains As; approaches zero as ną — oo. 
This limit is the same for any sequence of type (2), that is, it is 
independent either of the way D is partitioned into subdomains As; 
or of the choice of the point P, inside a subdomain As,. 

This limit is called the double integral of the function f(x, y) 
over D and is denoted by 


(FFP) ds or Wr (x, y) dx dy, 


D 
that is, 


. h 
anM 9 PDAS = S Fle, v) dedy 
This domain D is called the domain (region) of. integration. 

If f(x, y)=0, then the double integral of f(x, y) over D is 
equal to the volume of the solid Q bounded by surface z= f (x, y), 
the plane z=0, and a cylindrical surface whose generators are 
parallel to the z-axis, while the directrix is the boundary of the 
domain D (Fig. 45). 

Now consider the following theorems about the double integral. 
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Theorem 2. The double integral of a sum of two functions 
p(x, y) +(x, y) over a domain D is equal to the sum of the 
double integrals over D of each of the functions taken separately: 


[Stow +e pids=Sloc, ydst+ ffy, yds 
D D D 
Theorem 3. A constant factor may be taken outside the double 
integral sign: 
if a=const, then 


(Jap (x, yds=a$ p(x, y)ds 
D D 


The proof of both theorems is exactly the same as that of the 
corresponding theorems for the definite integral (see. Sec. 11.3, Vol. I). 


Fig. 46 Fig. 47 


Theorem 4. /f a region D is divided into iwo domains D, and 
D, without common interior points, and a function f(x, y) is 
continuous at all points of D, then 


(Fæ yydxdy=SS f(x, ydxdy+ [f F yydxdy (3) 


D D 


Proof. The integral sum over D may be given in the form 
(Fig. 46) 


Zi (Pi) Asi = DF (P: As, + Bf (Pi) As; (4) 
D, Da 


where the first sum contains terms that correspond to the subdo- 
mains of D,, the second, those corresponding to the subdomains 
of D,. Indeed, since the double integral does not depend on the 
manner of partition, we divide D so that the common boundary 
of the domains D, and D, is a boundary of the subdomains As;. 
Passing to the limit in (4) as As;— 0, we get (3). This theorem 
is obviously true for any number of terms. 
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2.2 CALCULATING DOUBLE INTEGRALS 


Let a domain D lying in the xy-plane be such that any straight 
line parallel to one of the coordinate axes (for example, the y-axis) 
and passing through an interior* poinf of the domain, cuts the 
boundary of the domain at two points N, and N, (Fig. 47). 

In this case we assume that the domain D is bounded by the 
lines: y =Q, (x), Y =P, (x), x=a, x=b and that 


Pı (x) SP: (x), a<b 
while the functions ọ, (x) and ọ,(x) are continuous on the interval 
[a, b]. We shall call such a domain regular in the y-direction. The 
definition is similar for a domain regular in the x-direction. 

A domain that is regular in both x- and y-directions we shall 
simply call a regular domain. In Fig. 47 we have a regular 
domain D. 

Let the function f(x, y) be continuous in D. 

Consider the expression 


b Gs (x) 
=$ f FG, yydy) dx 
a \q: (x) ‘ 
which we shall call a twofold iterated integral of f(x, y) over D. 
In this expression we first calculate the integral in the parentheses 
(the integration is performed with respect to y while x is considered 
to be constant). The integration yields a continuous ** function of x: 

Q2 (x) 

D= È Fle, yay 

Pı (x) 
Integrating this function with respect to x from a to b, 

b 

Ip= | © (x)dx 

a 

we get a certain constant. 


Example. Calculate the twofold iterated integral 


1x 
Ip=S (í (+y?) ay a 
0\0 


Solution. First calculate the inner integral (in brackets): 


© (2) = | etd (sty +E) mate SP oy 
0 


* An interior point of a domain is one that does not lie on its boundary. 
** We do not prove here that the function ® (x) is continuous. 


11—2082 
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Integrating the function obtained from 0 to 1, we find 
1 
x6 x x? \I I 1 26 
4 ——s => are. ae =. — IIe 
NG +3 ) de ( 5 +37), 5 +317" 105 
Determine the domain D. Here, D is the domain bounded by the lines (Fig. 48) 
y=0, x=0, y=x?, x=1 


It may happen that the domain D is such that one of the func- 
tions y=q,(x), ¥=,(x) cannot be represented by one analytic 


Fig. 49 


expression over the entire range of x (from x=a to x=b). For 
example, let a<c<b, and 

p, (x) = (x) on the interval [a, c] 

Pı (x) = x(x) on the interval [c, b] 


where (x) and x(x) are analytically specified functions (Fig. 49). 
Then the twofold iterated integral will be written as follows: 


b 7, (x) N 
{( | Fe. y)dy )dx 
a 1 (x) 


d 


cha (xy b T2 (x) 
=i f f (x, dy act ( f f(x, y) dy de 


a Ng (x) E \qy (x) 


c h (x) b G2 (x) 
=f f fæ sdy Jax + ace v) dy Jdr 
a \p(x) c NX) 4 

The first of these equations is written on the basis of a familiar 
property of the definite integral, the second, by virtue of the 
fact that on the interval [a, c] we have ọ,(x)=Ņ (x), and on 
the interval [c, b] we have 9, (x) = x (x). 

We would also have a similar notation for the twofold iterated 
integral if the function @,(x) were defined by different analytic 
exoressions on different subintervals of the interval fa, b]. 
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Let us establish some properties of a twofold iterated integral. 

Property 1. /f a regular y-direction domain D is divided into 
two domains D, and D, by a straight, line parallel to the y-axis 
or the x-axis, then the twofold iterated integral Ip over D will be 
equal to the sum of such integrals over D, and D,; that is, 


Ip=!p,+/p, (1) 


Proof. (a) Let the straight line x=c (a<c<b) divide the 
region D into two regular y-direction domains* D, and D,. Then 


b; b c b 
In=§( | F, sdy )dr=§ om dr= f D (drt f @ (9 de 
N 


c Pa (x) b / Q: (x) $ 
={( | Fe, y)dy axt ( | Fe, sdy dx= 1n, + To, 


a NỌ, (x) e Nọ: (x) 


(b) Let the straight line y=h divide the domain D into two 
regular y-direction domains D, and D, as shown in Fig. 50. 
Denote by M, and M, the points of 
intersection of the straight line y=h 
with the boundary L of D. Denote the 
abscissas of these points by a, and b,. 

The domain D, is bounded by con- 
tinuous lines: 

(1) y =Q, (x); 

(2) the curve A,M,M,B, whose 
equation we shall conditionally write 
in the form 


y= i (x) 
having in view that gj{(x)=@, (x) 


Fig. 50 
when axx<ca, and when b <x<b and that 


gi (x)=h when a [<x<b;; 


(3) by the straight lines x=a, x=b. 
The domain D, is bounded by the lines 


y=; (x), y=9,(x), where a <x <b, 


+ 


* The fact that a part of the boundary of the domain D, (and of Da) is a 
portion of the vertical straight line does not stop this domain from being reg- 
ular in the y-direction: for a domain to be regular, it is only necessary that 
any vertical straight line passing through an interior point of the domain 
should have no more than two common points with the boundary. 


ft 
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We write the identity by applying to the inner integral the 
theorem on partitioning the interval of integration: 


Pt aa) dy dx 


a Ng: (x) 


b y Fy) Qa (x) 
={( { fe ddyt+ J Fe, s) dy dx 


Çı (x) vy (x) 
by 1 (x) Gs 2 
=S( | fe najat \ F(x, dy ax 
G1 (x) CH (x) 


We break up the latter integral into three integrals and apply 
to the outer integral the theorem on partitioning the interval of 
integration: 


Pa (x) a, , Ça (x) 
a F(x, dy) dem V( | Fe, dy dx 


4 No J a \ eT) 
bi , F2 (x) b , Ge (x) 
+É § Fe ay Jax $ ( È Fe, s) dy ax 
ar \ gi (x) bi \ piw 


since pi (x)=. (x) on [a, a] and on [b,, b], it follows that the 
first and third integrals are identically zero. Therefore, 


b, 9%) by / Gs (x) 
=$ J fee say )av-+S( eee sdy ax 
91% “py (x) 


Here, the first integral is a twofold iterated integral over D,, 
the second, over D,. Consequently, 


Ip=!p,+!o, 


The proof will be similar for any position of the cutting straight 
line M,M,. If M,M, divides D into three or a larger number of 
domains, we get a relation similar to (1), in the first part of 
which we will have the appropriate number of terms. 

Corollary. We can again divide each of the domains obtained 
(using a straight line parallel to the y-axis or x-axis) into regular 
y-direction domains, and we can apply to them equation (1). 
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Thus, D may be divided by straight lines parallel to the coor- 
dinate axes into any number of regular domains 


D, Dy Dy -.., D; 


and the assertion that the twofold iterated integral over D is 
equal to the sum of twofold iterated 
integrals over the subdomains holds; 
that is (Fig. 51), 


Ip=1Ip,+1p, tot- +1; (2) 


Property 2 (Evaluation of an ite- 
rated integral). Let m and M be the 
least and greatest values of the func- 
tion f(x, y) in the domain D. De- 
note by S the area of D. Then we 
have the relation Fig. 51 

b Gs (x) ‘ 
ms <{( J Fe, ydy jde < MS (3) 


a Sgi (x) 


Proof. Evaluate the inner integral denoting it by D(x): 
Ça (x) Gs (x) 


@(x)= § f(x, ydy< | Mdy=M[9,()—9, (0) 


G1 (x) Fa (1) 


We then have 


b /Ẹ3 (x) 
1=$( f F (x, way) de) M Ipi) 0 (9) de= MS 


P1 (x) 
that is, 
Ip < MS (3’) 
Similarly 
@: (x) G2 (x) 
O(x)= J fle, dy> J mdy=m[g.()—9, (9) 
G1 A i G1 (x) 
Ip= | D (x) dx > | m [p, (x) — p, (x)] dx = mS 
that is, 
Ip>mS (3") 
From the inequalities (3’) and (3”) follows the relation (3): 
mS <1p<MS 


In the next section we will determine the geometric meaning of 
this theorem. 
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Property 3 (Mean-value theorem). A twofold iterated integral 
Ip of a continuous function f(x, y) over a domain D with area S 
is equal to the product of the area S by the value of the function 
at some point P in D; that is, 

b Qs (x) 


f | Fix, sdy Jax =F (P)S (4) 
a @1 (x) 


Proof. From (3) we obtain 
m< + In<M 


The number 5! p lies between the greatest and least values of 
f(x, y) in D. Due to the continuity of the function f(x, y), at 
some point P of D it takes on a value equal to the number + Ip; 
that is,. 

y /o=f (P) 


whence 
Ip=f(P)S (5) 


2.3 CALCULATING DOUBLE INTEGRALS (CONTINUED) 


Theorem. The double integral of a continuous function f(x, y) 
over a regular domain D is equal to the twofold iterated integral 
of this function over D; that is, * 


b Ga (x) 
Sree, yyaedy=(( | Fes, sdy a 
G1 (x) 


D a N 


Proof. Partition the domain D with straight lines parallel to the 
coordinate axes into n regular (rectangular) subdomains: 


As,, As,, ..., As, 
By Property 1 [formula (2)] of the preceding section we have 


n 
Ip= lss, + last -e + Tas, = Das, (1) 
i=l 


We transform each of the terms on the right by the mean- 
value theorem for a twofold iterated integral: 


Ias; = F (P;) As; 


* Here, we again assume that the domain D is regular in the y-direction 
and bounded by the lines y=q, (x), y= Qe (x), =a, x=, 
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Then (1) takes the form 
Tp=f (Py) As, +f (Ps) Asa +... +f (Px) AS, =A F (P;) As; (2) 


where P; is some point of the subdomain As;. On the right is the 
integral sum of the function f(x, y) over D. From the existence 
theorem of a double integral it follows that the limit of this 
sum, aS n— œ and as the greatest diameter of the subdomains 
As; approaches zero, exists and is equal to the double integral of 
f(x, y) over D. The value of the double integral /p on the left 
side of (2) does not depend on n. Thus, passing to the limit 
in (2), we obtain 


l= dim DE(P) Asi= SÈ FO, wdedy 


diam As;> 
or 
i5 f(x, y)dxdy=Ip (3) 


Writing, out in full the expression of the twofold iterated inte- 
gral Ip, we finally get 


b F @s (x) 
fF, naay= $| | fe, aglas (4) 
D a Ls, (x) 

Note 1. For the case where f(x, y) >0, formula (4) has a pic- 
torial geometric interpretation. Consider a solid bounded by a 
surface z= f(x, y), a plane z=0, and a cylindrical surface whose 
generators are parallel to the z-axis and the directrix of which 
is the boundary of the region z=f[x.y) 

D (Fig. 52). Calculate the vo- ; 
lume of this solid V. It has 
already been shown that the 
volume of this solid is equal 
to the double integral of the 
function f(x, y) over the do- 
main D: 

v= Wie, dxdy (6) 

D 

Now let us calculate the vo- 
lume of this solid using the Fig. 52 
results of Sec. 12.4, Vol. I, on 
the evaluation of the volume of a solid from the areas of parallel 
sections (slices). Draw the plane x= const (a < x < b) that cuts the 
solid. Calculate the area S(x) of the figure obtained in the sec- 
tion x= const. This figure is a curvilinear trapezoid bounded by 
the lines z=f (x, y) (x= const), z=0, y=Q, (x), y=, (x). Hence, 
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the area can be expressed by the integral 
Pe (x) 
Si) = J Fe, way 6) 
G1 (x) 
Knowing the areas of parallel sections, it is easy to find the 
volume of the solid: 


b 
V= f S (x) dx 
a 
ot, substituting expression (6) for the area S (x), we get 


b Gs (x) 

v=f( $ fe, Way ax (7) 
a XG; (x) i 

In formulas (5) and (7) the left sides are equal; and so the right 

sides are equal too: 


b G2 (x) 
IS Fe, dx dy ~S( | Fe, dy ax 
D a NẸ (x) 

It is now easy to figure out the geometric meaning of theorem 
oti evaluating a twofold iterated integral (Property 2, Sec. 2.2): 
the volume V of a solid bounded by the surface z= f(x, y), the 
plane z= 0, and a cylindrical sur- 
face whose directrix is the boun- 


dary of the region D, exceeds the volume of a cylinder with base 
area S and altitude m, but is less than the volume of a cylinder 
with base area S and altitude M [where m and M are the least 
and greatest values of the function z= f(x, y) in the domain D 
(Fig. 53)]. This follows from the fact that the twofold iterated 
integral Jp is equal to the volume V of this solid. 
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Example 1. Evaluate the double integral {È (4—12 —y?) dx dy if the do- 
D 


3 
main D is bounded by the straight lines x=0,%=1, y =0, and y=7: 
Solution. By the formula 


1 ss 


v= [faamalu] [r-o] t 
6 Lo ö 
3/3 


af (fon (v-e 


Example 2. Evaluate the double integral of the function f(x, yy=I+x+y 
over a region bounded by the lines y =— x, x= Vy, y=2, z=0 (Fig. 54). 
Solution. 


V= 


2 
0 
2 3 7 
|a? 3a yT P| 4 13 
| Pare he iets 


Note 2. Let a regular x-direction domain D be bounded by the 
lines 


x=, (4), x=Ħ%Ņ: (4), y=c, y=d 


and let sp, (y) <<, (y) (Fig. 55). 
In this case, obviously, 


d 7Y: (y) 
Wace pdedy=S( $ Fx, shar dy (8) 
c 1 (y 


D 


To evaluate the double integral we must represent it as a twofold 
iterated integral. As we have already seen, this may be done in 
two different ways: either by formula (4) or by formula (8). 
Depending upon the type of domain D or the integrand in each 
specific case, we choose one of the formulas to calculate the 
double integral. 
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Example 3. Change the order of integration in the integral 
1/Vx 
=f ( f f (x, way )a 
0 x 


Solution. The domain of integration is bounded by the straight line y =x 
and the parabola y= V x (Fig. 56). 


Fig. 55 Fig. 56 Fig. 57 


Every straight line parallel to the x-axis cuts the boundary of the domain 
al no more than two points; hence, we can compute the integral by formula (8), 
setting 


hy=y, p (y)=y, O<y<l 


lyy 
={(J f(x, wae a 
0 


y? 


then 


v 
Example 4. Evaluate S) e* ds if the domain D is a triangle bounded by 


D 
the straight lines y =x, y=0, and x=1 (Fig. 57). 
Solution. Replace this double integral by a twofold iterated integral using 
formula (4). [If we used formula (8), we would have to integrate the function 
y 


e* with respect to x; but this integral is not expressible in terms of elemen- 
tary functions]: 


jp aif f aag [et Tea 


1 
24 = 
=Èxe— a= e-f 1 =E =0.859... 
0 


Note 3. If the domain D is not regular either in the x-direction 
or the y-direction (that is, there exist vertical and horizontal 
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straight lines which, while passing through interior points of the 
domain, cut the boundary of the domain at more than two points), 
then we cannot represent. the double integral over this domain in 
the form of a twofold iterated integral. Mf we manage to partition 
the irregular domain D into a finite number of regular x-direction 
or y-direction domains D,, D,, ..., D,, then, by evaluating the 
double integral over each of these subdomains by means of the 
twofold iterated integral and adding the results obtained, we get 
the sought-for integral over D. 


x 


Fig. 58 Fig. 59 


Fig. 58 is an example of how an irregular domain D may be 
divided into three regular subdomains D,, D, and D,, 


Example 5. Evaluate the double integral 


(Jena 


over a domain D which lies between two squares with centre at the origin and 
with sides parallel to the axes of coordinates, if each side of the inner square 
is equal to 2 and that of the outer square is 4 (Fig. 59). 

Solution. D is irregular. However, the straight lines x=— l and x=1 di- 
vide it into four regular subdomains D,, Dg, Ds, D4. Therefore, 


Y e*+yds= È ex+¥ ds+ i) ex+y as+ f f exty ds +({ ex+¥ ds 
D 


1 a 3 4 


Representing each of these integrals in the form of a twofold iterated integral, 
we find 


9) ex+y ds= | f exty alaf [Sew J dx 


1 -1 i 2 2 
+ f | f as ay laet fl f v ay |as 
-1L-2 ! i L-2 


= (e —e-~?) (e~1 —e-2) + (e —e) (e—e-1) + (e71 —e-?) (e—e-}) 
+ (e?—e- 2) (e? —e) = (e2? —e-8) (e—e-1) =4 sinh 3 sinh 1 
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Note 4. From now on, when writing the twofold iterated integral 


LF Ps (x) 
Ip = j k J Fes y) a| dx 


we will drop the brackets containing the inner integral and will 
write 


b Ç: (x) 


Ip=f f f(x, y)dydx 


a Q: (x) 


Here, just as in the case when we have brackets, we will consider 
that the first integration is performed with respect to the variable 
whose differential is written first, and then with respect to the 
variable whose differential is written second. [We note, however, 
that this is not the generally accepted practice; in some books 
the reverse is done: integration is performed first with respect to 
the variable whose differential is last.*] 


2.4 CALCULATING AREAS AND VOLUMES 
BY MEANS OF DOUBLE INTEGRALS 


1. Volume. As we saw in Sec. 2.1, the volume V of a solid 
bounded by a surface z= f(x, y), where f(x, y) is a nonnegative 
function, by a plane z=0 and by a cylindrical surface whose 
directrix is the boundary of the domain D and the generators are 
parallel to the z-axis, is equal to the double integral of the func- 
tion f(x, y) over D: 


v= fæ, sds 
D 
Example 1. Calculate the volume of a solid bounded by the surfaces x= 0, 
y=0, x+y+2=1, z=0 (Fig. 60). 
Solution. 
V= (f (1 —x— y) dy dx 
D 


where D is (in Fig. 60) the hatched triangular region in the xy-plane bounded 
by the straight lines x=0, y=0, and x+ y= 1. Putting the limits on the double 


* The following notation is also sometimes ‘used: 


oT Qs b G2 
Ip=) [i f(x, nay |e {a Fx, v) dy 


al a P1 
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integral, we calculate the volume: 
ll-x 1 


ea f (Iw) dude = | [0-9 F], a= |p —atarmy 


Thus, v=t cubic units. 

Note 1. If a solid, the volume of which is being sought, is 
bounded above by the surface z= ®, (x, y) >0, and below by the 
surface z=, (x, y) >0, and the domain D is the projection of 


Z 2=®,(Z.g) 


WANS 2 
g Tty=1 


Fig. 60 


both surfaces on the xy-plane, then the volume V of this solid is 
equal to the difference between the volumes of the two “cylindri- 
cal” bodies; the first of these cylindrical bodies has the domain D 
for its lower base, and the surface z= ®, (x, y) for its upper base; 
the second body also has D for its lower base, and the surface 
z=@,(x, y) for its upper base (Fig. 61). 

Therefore, the volume V is equal to the difference between the 
two double integrals 


V=f f D, (x, yyds—S§ O, (x, yds 
D D 


or 
V=|f [D, (x, y)—®, (x, y)]ds (1) 


D 
Further, it is easy to prove that formula (1) holds true not 
only for the case where ®, (x, y) and ®, (x, y) are nonnegative, but 
also where ®, (x, y) and ®,(x, y) are any continuous functions 
that satisfy the relationship 


@, (x, y) >P, (x, y) 


Note 2. If in the domain D the function f(x, y) changes sign, 
then we divide the domain into two parts: (1) the subdomain D, 
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where f(x, y) 0; (2) the subdomain D, where f(x, y) <0. Sup- 
pose the subdomains D, and D, are such that the double integrals 
over them exist. Then the integral over D, will, be positive and 
equal to the volume of the solid lying above the xy-plane. The 
integral over D, will be negative and equal, in absolute value, to 
the volume of the solid lying below the xy-plane. Thus, the in- 
tegral over D will be expressed as the difference between the cor- 
responding volumes. 

2. Calculating the area of a plane region. If we form the inte- 
gral sum of the function f(x, y)= 1l over the domain D, then this 
sum will be equal to the area S, 


n 
S=) 1. As; 
t=1 


for any mode of partition. Passing to the limit on the right side 
of the equation, we get 
S= {fax dy 
D 


If D is regular (see, for instance, Fig. 47), then the area will be 
expressed by the iterated integral 


b TỌ: (x) 
S= jl f a| dx 
a1 (x) 

Performing the integration in the brackets, we obviously have 


b 
S= Í [pa (9—9; (2)] dx 
(cf. Sec. 12.1, Vol. I). 


Example 2. Calculate the area of a region bounded by the curves 
y=2—x, y=x 
Solution. Determine the points of intersection of the given curves (Fig. 62). 
At the point of intersection the ordinates are equal; that is, 
x=2—x? 
whence 
x+x—2=0 
x,=—2 
Xa = 1 
We get two points of intersection: M, (—2, —2), M, (1, 1). Hence, the required 
area is 
2-x? 


=f (f oja- [enema [ag], 
x -2 


-2 


Ke] 
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2.5 THE DOUBLE INTEGRAL IN POLAR COORDINATES 


Suppose that in a polar coordinate system 0, p, a domain D is 
given such that each ray* passing thréugh an interior point of 
the region cuts the boundary of D at no more than two points. 
Suppose that D is bounded by the curves p = ®, (0), p = ®, (0) and 
the rays 8=a@ and 0 = $f, where ®, (6) < ®, (0) and a < f (Fig. 63). 
Again we shall call such a region a regular domain. 


y 
) 
y 


A 4 
Fig. 62 Fig. 63 


Let there be given in D a continuous function of the coordi- 
nates 0 and p: 


z=F (8, p) 
We divide D in some way into subdomains As,, AS, ..., As,. 
Form the (integral) sum i 
n 
Va = È F (Ps) Asr (1) 


where P, is some point in the subdomain As,. 

From the existence theorem of a double integral it follows that 
as the greatest diameter of the subdomain As, approaches zero, 
there exists a limit V of the integral sum (1). By definition, this 
limit V is the double integral of the function F (6, p) over the 
domain D: 

= F , 
V y (8, p)ds (2) 


Let us now evaluate this double integral. 


* A ray is any half-line issuing from the coordinate origin, that is, from 
the pole P. 
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Since the limit of the sum is independent of the manner of par- 
titioning D into subdomains As,, we can divide the domain in a 
way that is most convenient. This most convenient (for purposes 
of calculation) manner will be to partition the domain by means 
of the rays 0=0,, 0=0,, 0=9,, ..., 0=0, (where 0,=a, 0,=6, 
8,<0,<6,<...<6,) and the concentric circles p= pP, P=Pr, 

, P=P, Í [where pe is equal to the least value of the function 
D, 0), and Pa, to the greatest value of the function ®, (6) in the 
interval a KOPB, PLP <- < Pahl- 

Denote by Asie ae subdomain Bounded by the lines p=9,-,, 
p=p;, 9=O,-,, 0= 

The subdomains re will be of three kinds: 

(1) those that are not cut by the boundary and lie in D; 

(2) those that are not cut by the boundary and lie outside D; 

(3) those that are cut by the boundary of D. 


The sum of the terms corresponding to the cut subdomains have 
zero as their limit when A6é,—+0 and Ap;—-0 and for this reason 
these terms will be disregarded. The subdomains As,, that lie 
outside D do not interest us since they do not enter into the sum. 
Thus, the sum may be written as follows: 


va= $ [EF (Pa) Asa] 


where P;, is an arbitrary point of the subdomain As;,. 

The double summation sign here should be understood as mean- 
ing that we first perform the summation with respect to the in- 
dex i, holding k fast (that is, we pick out all terms that corres- 
pond to the subdomains lying between two adjacent rays*). The 
outer summation sign signifies that we take together all the sums 
obtained in the. first summation (that is, we sum with respect to 
the index &). 

Let us find the expression of the area of the subdomain As,, 
that is not cut by the boundary of the domain. It will be equal 
to the difference of the areas of the two sectors: 


l 1 A 
ASin = g (0: + Api) AO, — g PAO = Q +°$!) Ap; A0, 
or 
As;, = P? Ap;A®,, where p; < p? < p: + Ap; 


* Note that in summing with respect to the index i this index will not run 
through all values from 1 to m, because not all of the subdomains lying between 
the rays 0=0; and 0=6,,, belong to D. 
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Thus, the integral sum will have the form * 


V, == È [> F (0%, pi) Pe Ap,A0, | 


where P (0k, pf) is a point of the subdomain As;,. Now take the 
factor A0, outside the sign of the inner sum (this is permissible 
since it is a common factor for all the terms of this sum): 


n 
Va= È | BF (8b, pi) e7Ap;| A0 


Suppose that Ao;-—+0 and A0, remains constant. Then the ex- 
pression in the brackets will tend to the 
integral 

D, (03) 
F (0k, p) p dp 
D, (9%) 
Now, assuming that A0, — 0, we finally 
get wok 


B /@, (8) 
v-\( Fe, p) pp ) (3) P 


Fig. 64 


Formula (3) is used to compute double integrals in polar coor- 
dinates. 

If the first integration is performed with respect to @ and the 
second one to p, then we get the formula (Fig. 64) 


Os /Ws (9) 
Ve i( | FO, 9) d8 )p dp (3’) 


Pı ~O: (P) 


* We can consider the integral sum in this form because the limit of the 
sum does not depend on the position of the point inside the subdomain. 

** Our derivation of formula (3) is not rigorous; in deriving this formula we 
first let Ap; approach zero, leaving A@, constant, and only then made A0% 
approach zero. This does not exactly correspond to the definition of a double 
integral, which we regard as the limit of an integral sum as the diameters of the 
subdomains approach zero (i.e., in the simųltaneous approach to zero of AO, 
and Ap;). However, though the proof lacks rigour, the result is true [i.e., for- 
mula (3) is true]. This formula could be rigorously derived by the method 
used when considering the double integral in rectangular coordinates. We also 
note that this formula will be derived once again in Sec. 2.6 with different rea- 
soning (as a particular case of the more general formula for transforming coor- 
dinates in a double integral). 


12 2082 
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Let it be required to compute the double integral of a function 
f(x, y) over a domain D given in rectangular coordinates: 


\\ Fe, y) dxdy 


D 


If D is regular in the polar coordinates 6, p, then the computation 
of the given integral can be reduced to computing the iterated 
integral in polar coordinates. 
Indeed, since 
x=pcosð, y=psin6 
f(x, y) =f [p cos @, psin 0] =F (0, p), 
it follows that 


B /®, (8) 
(iF naray=$( f f [pcos 9, p sin] p dp ) (4) 


D a \q@, (8) 


Example 1. Compute the volume V of a solid bounded by the spherical surface 


x24 y3 + 2? = 4a? 
and the cylinder 
x+y? — 2ay =0 
solution. For the domain of integration here we can take the base of the 
cylinder x?-+ y?—2ay =0, that is, a circle with centre at (0, a) and radius a. 
The equation of this circle may be 


Z written in the form x?-+ (y— a)? =a? 
(Fig. 65). 


yz? 4a? 


2a 
T?+(y-a)?=0? y 
Fig. 65 Fig. 66 


We calculate F of the required volume V, namely that part which is situated 


in the first octant. Then for the domain of integration we will have to take the 
semicircle whose boundaries are defined by the equations 


x=91(y)=0, x= (y) = V2ay— 
y=0, y=2a 


2=f (x, = Via AA 


The integrand. is 
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Consequently 
a ,V2ay—y? 
N f VITET te ay 
0 0 g 
Transform the integral obtained to the polar coordinates 6, p: 
x=pcosð, y=psinð 


Determine the limits of integration. To do so, write the equation of the 
given circle in polar coordinates; since 


x+y = p? 
=p sin ð 
it follows that 
p? — 2ap sin 0=0 
or 
p = 2a sin 8 


Hence, in polar coordinates (Fig. 66), the boundaries of the domain are defined 
by the equations 


p=, (()=0, p=, (6)=—2asin0, a=0, p=> 


and the integrand has the form 


F (8, p)= V 4a?— p? 
Thus, we have 3 
2 / 2a sin 6 
Vie 
T= 
0 


x 
z 
ENEE 2 — n2)8/2] 2a sin 0 
V 4a®— pip dp a=f |- Caia Ua) eenn dð 
0 


0 


uv 

T , f 

yfi (4a3— 4a? sin? 0)?/? — (4a)*/2] do 8a" f (1 — cos? 6) d8 
0 0 


=s 
=5 a® (3n — 4) 
Example 2. Evaluate the Poisson integral 
+o 
f e-** dx 
-0 


Solution. First evaluate the integral / R= f f e-%?~¥? dx dy, where the domain 


of integration D is the circle x?+ y3 = R? Fig. 67). 
Passing to the polar coordinates 8, p, we obtain 


1 2a R 
Ip= (f e~ep tp = — 3 fezo | dð=nx (1 —e-RÌ 
0 0 
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Now, if we increase the radius R without bound (that is, if we expand 
without limit the domain of integration), we get the so-called improper iterated 
integral: 


2n pœ an R \ 

f (5 cP p dp d= lim \ (i ey do ) dð= lim n(l—e-R*)= 0 

Ò \a Roe 9 \ò RIP 

We shall show that the integral (f e~**-¥* dx dy approaches the limit x if 
D 


a domain D’ of arbitrary form expands in such manner that finally any point 


of the plane is in D’ and remains there (we shall conditionally indicate such 
an expansion of D’ by the relationship D’ —+0o). 


Fig. 67 Fig. 68 


Let R, and R, be the least and greatest distances of the boundary of D’ 
from the origin (Fig. 68). 

Since the function e7* -8 
inequalities hold: 


is everywhere greater than zero, the following 


Ip < È È eo ¥" dx dy <a 
p 


or 
a(ine i)a f eee EA E *s) 
D 


Since as D’ —+o it is obvious that R, —+o and R, — œ, it follows that 
the extreme parts of the inequality tend to the same limit n. Hence, the 
middle term also approaches this limit; that is, 


lim f e7*-8 dxdy=n (5) 
D'>o D 
As a particular instance, let D’ be a square with side 2a and centre at the 
origin; then 
a a 
gi e774" dx dy = f (arei dx dy 
D’ -a-a 
a a 


ay a 
= ( f e=x2e7 t" dx dy = It Ç e=3te=0" de \dy 
a -4 


-a-a - / 
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Now take the factor e~” outsidé the sign of the inner integral (this is per- 
missible since e~4* does not depend on the variable of integration x). Then 


{Ver Hae dy = fen( feos ts )ay 
D 


j -a -a 
a 


Set | e=" dr = By. This is a constant (dependent only on a); therefore, 


a a 
(er dx dy = | e" Ba dy = Ba f emt" ay 
7 -a -4 


a 
But the latter integral is likewise equal to Ba (because ( e-** dx = 


Gi 
~a 


a 
= fez ay ); thus, 


-a d 


f f e~**- 9" dx dy= BaBa = B? 
J 


We pass to the limit in this equation, by making a approach Infinity (in the 
process, D’ expands without limit): 


a 2 +o 2 
lim (f e=- dx dy = lim B= lim f e= dx = f e-*? dx 
D'>e ‘D? a> o a> a =a 


But, as has been proved [see (5)], 


lim f ce -4 dxdy=n 


D'>@ 
Hence, 

D 2 

| f ad =n 
-> 

or 

oe 
[e#dx= Vi 
=- 


This integral is frequently encountered in probability theory and in statistics. 
We remark that we would not be able to compute this integral directly (by 
means of an indefinite integral) because the antiderivative of e~*? is not expfes- 
sible in terms of elementary functions. 
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2.6 CHANGE OF VARIABLES IN A DOUBLE INTEGRAL 
(GENERAL CASE) 


In the xy-plane let there be a domain D bounded by a line L. 
Suppose that the coordinates x and y are functions of new vari- 
ables u and v: 


x= (u, v), y=Ņ (u, v) (1) 


Let the functions ọ (u, v) and y(u, v) be single-valued and con- 
tinuous, and let them have continuous. derivatives in some do- 
main D’, which will be defined later on. Then by formulas (1) 
to each pair of values u and v there corresponds a unique pair 
of values x and y. Further, suppose that the functions ọ and p 
are such that if we give x and y definite values in D, then by 
formulas (1) we will find definite values of u and v. 


Fig. 70 


Consider a rectangular coordinate system Ouv (Fig. 69). From 
the foregoing it follows that with each point P(x, y) in the xy- 
plane (Fig. 70) there is uniquely associated a point P’ (u, v) in 
the uv-plane with coordinates u, v, which are determined by for- 
mulas (1). The numbers u and v are called curvilinear coordina- 
tes of the point P. 

If in the xy-plane a point describes a closed line L bounding 
the domain D, then in the uv-plane a corresponding point will 
trace out a closed line L’ bounding a certain domain D’; and to 
each point of D’ there will correspond a point of D. 

Thus, the formulas (1) establish a one-to-one correspondence 
between the points of the domains D and D’, or, the mapping, by 
formulas (1), of D onto D’ is said to be one-to-one. 

In the domain D’ let us consider a line u= const. By formu- 
las (1) we find that in the xy-plane there will, generally speak- 
ing, be a certain curve corresponding to it. In exactly the same 
way, to each straight line v= const of the uv-plane there will cor- 
respond some line in the xy-plane. 
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Let us divide D’ (using the straight lines u=const and 
v= const) into rectangular subdomains (we shall disregard subdo- 
mains that overlap the boundary of the region D’). Using suit- 
able curves, divide D into certain ° curvilinear quadrangles 
(Fig. 70). 

Consider, in the uv-plane, a rectangular subdomain As’ bounded 
by the straight lines u = const, u + Au = const, v = const, v + Av= 
= const, and consider also the curvilinear subdomain As corres- 
ponding to it in the xy-plane. We denote the areas of these sub- 
domains by As’ and As, respectively. Then, obviously, 


As’ = Au Av 
Generally speaking, the areas As and As’ are different. 
Suppose in D we have a continuous function 
z=[(x, y) 


To each value of the function z=f(x, y) in D there corres- 
ponds the very same value of the function z=F (u, v) in D’, 


where 
F (u, o) =f [p (u, v), pu, v)] 
Consider the integral sums of the function z over D. It is 
obvious that we have the following equation: 
Dix, y) As= D>) F (u, v) As (2) 
Let us compute As, which is the area of the curvilinear quad- 
rangle P,P,P,P, in the xy-plane (see Fig. 70). 
We determine the coordinates of its vertices: 


P, (x,, Y), x,= 9 (u, v), Yy, =Ņ (u, v) 

P, (X2 Y2), X= Ẹ (u + Au, v), Ya =Ņ (u + Au, v) 

P, (Xs, Ys), Xa = P(u+Au, v+ Av), y,=4Ņ (u+ Au, v+ Av) (3) 
P, (Xa, Y), X= 9 (u, v+ Ad), y= (u, v+ Av) 


When computing the area of the curvilinear quadrangle P,P,P,P, 
we shall consider the lines P,P., P,P;, PPa, P,P, as parallel in 
pairs; we shall also replace the increments of the functions by 
corresponding differentials. We shall thus ignore infinitesimals of 
order higher than the infinitesimals Au, Av. Then formulas (3) 
will have the form 


x,=Q@(u, v), y,=Ņ lu, v) 
x, = (u, +2 Au, y,= (u, v) +2 Au 


x5=9(u, )+2Aut+ Lav, y= plu, HEA A 


lv 


P(t, )+SE Av, y= (4, )+5% do j 


(3°) 
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With these assumptions, the curvilinear quadrangle P,P,P;P, 
may be regarded as a parallelogram. Its area As is approxima- 
tely equal to the doubled area of the triangle P,P,P, and is found 
by the following formula of analytic geometry: 


As = | (X3—%,) (Ys— Ya) — (Xa — Xa) (Ys—41) | 


=| (52 Au + 52 Av ) SP Av — 2 Av (SP Au + St Av J 
| OG OP — 2e — | 223p __ 2g Iy 
=| ay Au Ava Ju Audv| = du dv do du | Au Av 
op OY 
du ðv 
=H ap ay Au Av 
du dv 


Here, the outer vertical lines indicate that the absolute value of 
the determinant is taken. We introduce the notation 


ap Op 
ðu ðv 
ay oy |5 
Ou ov 
Thus, 
As = | I | As’ (4) 


The determinant / is called the functional determinant of the 
functions @(u, v) and p(u, v). It is also called the Jacobian after 
the German mathematician Jacobi. 

Equation (4) is only approximate, because in the process 
of computing the area of As we neglected infinitesimals of higher 
order. However, the smaller the dimensions of the subdomains As 
and As’, the more exact will this equation be. And it becomes 
absolutely exact in the limit, when the diameters of the subdo- 
mains As and As’ approach zero: 


As 
j= lim =, 
| | diam As’>0 As 


Let us now apply the equation obtained to an evaluation of 
the double integral. From (2) we can write 


Dit, y) Asx DF (u, v)|/| As’ 


(the integral sum on the right is extended over the domain D’). 
Passing to the limit as diam As’—+0, we get the exact equation 


VS Fe, y) dx dy = Y F (u, v) | I |dudv (5) 
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This is the formula for transformation of coordinates in a double 
integral. It permits reducing the evaluation of a double integral 
over a domain D to the computation of a double integral over a 
domain D’, which may simplify the problem. A rigorous proof of 
this formula was first given by the noted Russian mathematician 
M. V. Ostrogradsky. 

Note. The transformation from rectangular coordinates to polar 
coordinates considered in the preceding section is a special case 
of change of variables in a double integral. Here, u=0, v=p: 


x=pcosð, y=psind 


The curve AB(p=p,) in the xy-plane (Fig. 71) is transformed 
into the straight line A’B’ in the Op-plane (Fig. 72). The curve 


Fig. 71 Fig. 72 


DC (p=p,) in the xy-plane is transformed into the straight line 
D'C’ in the 60-plane. 

The straight lines AD and BC in the xy-plane are transformed 
into the straight lines A'D’ and B’C’ in the @p-plane. The curves 
L, and L, are transformed into the curves L; and Ly. 

Let us calculate the Jacobian of a transformation of the Car- 
tesian coordinates x and y into the polar coordinates © and p: 


Ox Ox 
06 Op —psin@ cos6 : ee 
ry ay dy |T| pcos® sin® = —p sin? 0—p cos? 0 = —p 
00 Op 
Hence, |/|=p and therefore 
B®, (8) 
VS Fe, y)dxdy~\\ f F (9, P) pdp dð 
p & \@, (0) ; 


This was the formula that we derived in the preceding section. 
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Example. Let it be required to compute the double integral 


{ f y—x) dx dy 
D 


over the region D in the xy-plane bounded by the straight lines 
1 7 1 
y=xtl, y=x—3, y= —Zexty, Y=- *t5 


It would be difficult to compute this double integral directly; however, a 
simple change of variables permits reducing this integral to one over a rect- 
angle whose sides are parallel to the coordi- 
nate axes. 

et 


u=y—x, v=y+5* (6) 
Then the straight lines y=x+1, y=x—3 
will be transformed, respectively, into the 
straight lines u=1, u=—3 in the uv-plane; 
and the straight lines y =- at 7’ 


y= = x+5 will be transformed into 


the - straight lines v=— , v=5. 


Fig. 73 Consequently, the given domain D is 

transformed into the rectangular domain D’ 

shown in Fig. 73. It remains to compute the Jacobian of the transformation. 

To do this, express x and y in terms of u and v. Solving the system of equations 
(6), we obtain 


-hetia seperi 
Consequently, 
Ox Ox 3 3 
fe du w| | 4 4 9 3 3 
lay oy| | 1 3| w6 6 4 
du dv 44 


and the absolute value of the Jacobian is | / \=4 . Therefore, 


if (y—x) ax ay = [(+ae+4")-( -F4+40)| 3 du do 


D D 
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2.7 COMPUTING THE AREA OF A SURFACE 


Let it be required to compute the area, of a surface bounded by 
a curve [ (Fig. 74); the surface is defined by the equation 
z=f (x, y), where the function f(x, y) is continuous and has con- 
tinuous partial derivatives. Denote the projection of IT’ on the 
xy-plane by L. Denote by D the domain on the xy-plane bounded 
by the curve L. 


T 


Fig. 74 Fig. 75 


In arbitrary fashion, divide D into n elementary subdomains 
As,, As,, ..., As,. In each subdomain As; take a point P; (&;, n). 
To the point P; there will correspond, on the surface, a point 


M; [$e ne FE n] 


Through M; draw a tangent plane to the surface. Its equation 
is of the form 


z— 2z; = fi(n n) (E) + fy Eo n) U — n) (1) 


(see Sec. 9.6, Vol. I). In this plane, pick out a subdomain Ao; 
which is projected onto the xy-plane in the form of a subdomain 
As;. Consider the sum of all the subdomains Ao;: 


> Ao; 
t=1 
We shall call the limit o of this sum, when the greatest of the 
diameters of the subdomains Ao; approaches zero, the area of the 


surface; that is, by definition we set 


n 
o= lim Ao; 2 
diam Ao; 0 È : A ( ) 
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Now let us calculate the area of the surface. Denote by y; the 
angle between the tangent plane and the xy-plane. Using a fami- 
liar formula of analytic geometry we can write (Fig. 75) 


As; = Ao; cos y; 
or 
Agee (3) 


cos Yi 


The angle y; is at the same time the angle between the z-axis 
and the perpendicular to the plane (1). Therefore, by equation 
(1) and the formula of analytic geometry we have 


COS y; hn ee 
‘ Vite (Ei, nd +F $i ni) 


Hence, 
Ao, =V I+ En n) +77 Eio n) As 
Putting this expression into formula (2), we get 
o= lim > VIFF Go n) +E Gi nd) As; 
diam As; >0 i= 
Since the limit of the integral sum on the right side of m last equation 
is, by definition, the double integral [f VE T +Y +Š y dx dy, 


oe MATORA VEY aedy (4) 


This is the formula used to compute the area of the surface 
z=f (x, y). 
If the equation of the surface is given in the form 

x=p(y, z) or in the form y =y% (x, z) 


we finally get 


then the corresponding formulas for calculating the surface area 
are of the form 


o= {I V 1+(2Y+(2Y. V+ (Z) dyaz (3’) 
o= || V 14(2) + (By araz (3”) 


where D’ and D” are the domains in the xy-plane and the xz-plane 
in which the given surface is projected. 
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Example 1. Compute the surface area o of the sphere 
x24 y2+- 2% R? 
Solution. Compute the surface area of the uppeg half of the sphere: 


z= VR 


Z gza? 


Fig. 76 
Fig. 76). In this case 
iia E 
Ox V Rè?—x?— yê 
əz y 
ðy =—V R8— xt? 


Hence, 


The domain of integration is defined by the condition 


x2 -}- y? < R2 
Thus, by formula (4) we will have 
R VR- x 
-R \-VRI=x 


To compute the double integral obtained let us make the transformation 
to polar coordinates. In polar coordinates the boundary of the domain of inte- 
gration is determined by the equation p= R. Hence, 


yR \ 2x 
o=2| | eae a0 —2R | [—VR— p20 d0 
3 g VR:—p? 5 


Qn 
=2R f R d0 =4n R? 
0 
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Example 2. Find the area of that part of the surface of the cylinder 
x4 y? =a? 
which is cut out by the cylinder 
x24 22a? 
Solution. Fig. 77 shows 1/8th of the desired surface. The equation of the 
surface has the form y= V a?—x?; therefore, 


Oy x oy =0 


ax Vaci a2 


VOTE) V ys 


The domain of integration is a quarter of the circle, that is, it is determined 
by the conditions 


LHR, x>09, z=0 


Consequently, 

a /Vat—x8 È a Va- xi a 
to=| f a ia tema | a dx=a\ dx =a? 
8 Va—x Va—x 

0 0 ; 0 0 0 


o = 8a? 


2.8 THE DENSITY DISTRIBUTION OF MATTER 
AND THE DOUBLE INTEGRAL 


In a domain D, let a certain substance be distributed in such 
manner that there is a definite amount per unit area of D. We 
shall henceforward speak of the distribution of mass, although our 
reasoning will hold also for the case when speaking of the distri- 
bution of electric charge, quantity of heat, and so forth. 

We consider an arbitrary subdomain As of the domain D. Let 
the mass of substance associated with this given subdomain be Am. 


Then the ratio = is called the mean surface density of the sub- 


stance in the subdomain As. 
Now let the subdomain As i and contract to the point 


P (x, y). Consider the limit lim 5 re If this limit exists, then, ge- 


nerally speaking, it will depend on the position of the point P, 
that is, upon its coordinates x and y, and will be some function 
f (P) of the point P. We shall call this limit the surface density 
of the substance at the point P: 


lim =F (P)=F (x, y) (1) 


Thus, the surface density is a function f (x, y) of the coordinates 
of the point of the domain. 
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Conversely, in a domain D, let the surface density of some sub- 
stance be given as a continuous function f (P)= F(x, y) and let it 
be required to determine the total quantity of substance M contained 
in D. Divide D into subdomains As; (i =1, 2, ...,) and in each 
subdomain take a point P,; then f(P,) is the surface density at 
the point P,. 

To within higher-order infinitesimals, the product f (P,) As; gives 
us the quantity of substance contained in the subdomain As,, and 
the sum 


pà f(P;) As; 


expresses approximately the total quantity of substance distributed 

in the domain D. But this is the integral sum of the function 

f(P) in D. The exact value is obtained in the limit as As;—-0. 
Thus,* 


M= lim > f (P) As;=§§ F(P)ds= [f F(x, dedy 9 
s;>0 i= D D 


or the total quantity of substance in D is equal to the double 
integral (over D) of the density f(P)=fF(x, y) of this substance. 


Example. Determine the mass of a circular lamina of radius R it the surface 
density f(x, y) of the material at each point P(x, y) is proportional to the 
distance of the point (x, y) from the centre of the circle, that is, i 


Fx, =k VEF 
Solution. By formula (2) we have 
m=\{ k VIET i} dx dy 
D 


where the domain of integration D is the circle x? + y? < R?. 
Passing to polar coordinates, we obtain 


2n ,R 3 R 
m= (fopap )ao— tans 
0 0 0 


2.9 THE MOMENT OF INERTIA OF THE AREA OF A PLANE FIGURE 


The moment of inertia I of a material point M of mass m re- 
lative to some point O is the product of the mass m by the square 
of its distance r from the point O: 


Il=mr' 


* The relationship As; +0 is to be understood in the sense that the dia- 
meter of the subdomain As; approaches zero. 
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The moment of inertia of a system of material points m,, m,, 
..., m, Telative to O is the sum of moments of inertia of the 
individual points of the system: 


I= x mir? 
Let us determine the moment of inertia of a material plane 
figure D. 
Let D be located in an xy-coordinate plane. Let us determine 


the moment of inertia of this figure relative to the origin, assuming 
that the surface density is everywhere equal 


to unity. 
Divide the domain D into elementary 
subdomains AS; (i == 1, 2, ..., n) (Fig. 78). 


In- each subdomain take a point P; with 
coordinates Ẹ;, m; Let us call the pro- 
duct of the mass of the subdomain AS; 
by the square of the distance r? = &?-+ n? 
an elementary moment of inertia A/; of 
the subdomain AS;: 


Al; = (& + n?) AS; 
and let us form the sum of such moments: 


2 Œ+ ni) AS; 


This is the integral sum of the function f(x, y)=x*?+y? over the 
domain D. 

We define the moment of inertia of the figure D as the limit 
of this sum when the diameter of each elementary subdomain AS, 
approaches zero: 


T= lim È G+ nt) AS, 


~~ diam AS; 70 i= 
But the limit of this sum is the double integral |{ (x? + y*) dx dy. 
D 
Thus, the moment of inertia of the figure D relative to the origin is 
1, = | | (x? ty") dx dy (1) 
D 


where D is a domain which coincides with the given plane figure. 
The integrals 


l= j5 y’ dx dy (2) 


Ty =\\ x dedy (3) 


D 
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are called, respectively, the moments of inertia of the figure D 
relative to the x-axis and y-axis. 


Example 1. Compute the moment of inertiaeof the area of a circle D of 
radius R relative to the centre O. 
Solution. By formula (1) we have 


l= $ | (3+ y?) de dy 
D 


To evaluate this integral we change to the polar coordinates 8, p. The equation 
of the circle in polar coordinates is p =R. Therefore 


2x ,R í 
0 


Note. If the surface density y is not equal to unity, but is some 
function of x and y, i.e., y=y(x, y), then the mass of the sub- 
domain AS; will, to within infinitesimals of higher order, be equal to 
v(E;, n) AS; and, for this reason, the moment of inertia of the 
plane figure relative to the origin will be 


= Wore y) (x+y?) dx dy (1’) 


Example 2. Compute the moment of inertia of a-plane material figure D 
bounded by the lines y?=1—x; x=0, y=O relative to the y-axis if the sur- 
face density at each point is equal to y 
(Fig. 79). 


y*=f-z 


Fig. 79 
Solution. 
1 Vi-x 1 Vi-x 1 
= 2 -|2 L| e ee ee 
lyy f x dy a= 5 dx=- | x° (1—x) dr = 55 
0 0 0 0 0 


Ellipse of inertia. Let us determine the moment of inertia of 
the area of a plane figure D relative to some axis OL that passes 


13 --2082 
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through the point O, which we shall take as the coordinate origin. 
Denote by g the angle formed by the straight line OL with the 
positive x-axis (Fig. 80). 

The normal equation of OL is 


xsing@—ycosg=0 
The distance r of some point M(x, y) from this line is 
r=|xsing—ycos@| 


The moment of inertia / of the area of D relative to OL is 
expressed, by definition, by the integral 


[l= j5 r? dx dy = p (x sin p — y cos ọ)?dx dy 


= sin’ {È x8 dx dy— 2sin coso | È xy dx dy +cos? p (f ydxdy 
D D 
Therefore ° 


I = I sin’ p—2/,, sin p cos @ + I yy COS’ P (4) 


here, Zy = i x? dx dy is the moment of inertia of the figure relative 
D 


to the y-axis, /,,= \\ y’ dxdy is the moment of inertia relative 
D 


to the x-axis, and /,,= {È xy dx dy. Dividing all terms of the last. 
D 
equation by /, we get 


2 i i 2 
e (A+ (BY © 
On the straight line OL take a point A(X, Y) such that 


1 
eo aT, 
To the various directions of the OL-axis, that is, to various values 
of the angle ọ, there correspond different values / and different 
points A. Let us find the locus of the points A. Obviously, 


=— cosg, Y=} sing 


VT VT 
By virtue of (5), the quantities X and Y are connected by the 
relation 
1=1,,,X?—21 y XY + 1,,Y? (6) 
Thus, the locus of points A(X, Y) is a second-degree curve (6). 
We shall prove that this curve is an ellipse. 
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The following inequality established by the Russian mathema- 
tician Bunyakovsky * holds true: 


(i xy dx ay) < ° 
<( jedan {i ax dy) 


D D 
or 
lel yy— 12, > 0 

Thus, the discriminant of the curve 
(6) is positive and, consequently, the 
curve is an ellipse (Fig. 81). This ellipse 
is called the ellipse of inertia. The 
notion of an ellipse of inertia is very Fig. 81 
important in mechanics. 

We note that the lengths of the axes of the ellipse of inertia 
and its position in the plane depend on the shape of the given 
plane figure. Since the distance from the origin to some point A 


* To prove Bunyakovsky’s (also spelt Buniakowski) inequality, we con- 
sider the following obvious inequality: 


{i [f (x, y) — io (x, y)P dx dy>0 
D 


where À is a constant. The equality sign is possible only when f(x, y)— 


—Ag (x, y) =0; that is, if f(x, y)=ìọ (x, y). If we assume that oe £ 
Æ const =A, then the inequality sign will always hold. Thus, removing brackets 
under the integral sign, we obtain 


(Ò Pi ydedy—2a [È fi, Wel, ydedy+o |È g(x, wdedy >0 
D D D 


Consider the expression on the left as a function of A. This is a second-degree 
polynomial that never vanishes; hence, its roots are complex, and this will occur 
when the discriminant formed of the coefficients of the quadratic polynomial 
is negative, that is, 


(i fp dx ae Y P dr dy i q? dx dy <0 
(5 fp dx a y f? dx dy iS q? dx dy 


This is Bunyakovsky’s inequality. 
In our case, f(x, y) =x, p(x, y)=y, £ Æ const. 


Bunyakovsky’s meguality is widely used in various fields of mathematics. 
In many textbooks it is called Schwarz’ inequality. Bunyakovsky published it 
tamang other important inequalities) in 1859. Schwarz published his work 16 
years later, in 1875. 


13 * 
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of the ellipse is equal to =F where / is the moment of inertia 


of the figure relative to the OA-axis, it follows that, after cons- 
tructing the ellipse, we can readily calculate the moment of 
inertia of the figure D relative to some straight line passing through 
the coordinate origin. In particular, it is easy to see that the 
moment of inertia of the figure will be least relative to the major 
axis of the ellipse of inertia and greatest relative to the minor 
axis of this ellipse. 


2.10 THE COORDINATES OF THE CENTRE OF GRAVITY 
OF THE AREA OF A PLANE FIGURE 


In Sec. 12.8, Vol. I, it was stated that the coordinates of the 
centre of gravity of a system of material points P,, Pa, .. 
with masses m,, m,, ..., m, are defined by the formulas 


Drim; Dyimi 
= ae (1) 
È mi Èm: 
Let us now determine the coordinates of the centre of gravity 
of a plane figure D. Divide this figure into very small subdo- 
mains AS;. If the surface density is taken equal to unity, then 
the mass of a subdomain will be equal to its area. If it is ap- 
proximately taken that the entire mass of subdomain AS; is con- 
centrated in some point of it, P;(&;, n,), the figure D may be 
regarded as a system of material points. Then, by formulas (1), 
the coordinates of the centre of gravity of this figure will be 
approximately determined by the equations 


So Py 


Xc 


i 


n n 
pa EAS; > nS; 
Xo —— ; Yo fel 
> As: 
i=l 
In the limit, as AS; — 0, the integral sums in the numerators 
and denominators of the fractions will pass into double integrals, 
and we will obtain exact formulas for computing the coordinates 
of the centre of gravity of a plane figure: 


| f xaedy fi ydx dy 

_ D = D 

ffaw “7 a . 
D D 


These. formulas, which have been derived for a plane figure with 
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surface density 1, obviously hold true also for a figure with any 
other density y constant at all points. 
If, however, the surface density is variable, 


y=v(% y) ° 
then the corresponding formulas will have the form 
fire y) x dx dy ff re, y) y dx dy 
te aeea ee) e 
\\ re, y) dx dy (fre y) dx dy 
D D 


The expressions M, = (f y(x, y) x dx dy and M, = Ky y(x, y) y dx dy 
D 


are called static moments of the plane y 
figure D relative to the y-axis and x-axis. 
The integral \§ y(x, y)dxdy expresses 
the quantity of mass of the figure in 
question. b 4, 
0 


Example. Determine the coordinates of the cen- 


tre of gravity of a quarter of the ellipse (Fig. 82) T T 


a 
x2 yr 
ae ee l Fig. 82 


assuming that the surface density at all points is equal to 1. 
Solution. By formulas (2) we have 


a/e ane P 
b =—— 
i f x dy dx of a? — x? x dx ae . L (aaah a 
0 _ a 3 C 


2.11 TRIPLE INTEGRALS 


Let there be given, in space, a certain domain V bounded by 
a closed surface S. Let some continuous function f(x, y, z), where 
x, y, z are the rectangular coordinates of a point of the domain, 
be given in V and on its boundary. For clarity, if f(x, y, 2) > 0, 
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we can regard this function as the density distribution of some 
substance in the domain V. 

Divide V, in arbitrary fashion, into subdomains Av;; the sym- 
bol Av; will denote not only the domain itself, but its volume as 
well. Within the limits of each subdomain Av,, choose an arbitrary 
point P; and denote by f(P;) the value of the function f at this 
point. Form a sum of the type 

Di (P;) Ao; (1) 
and increase without bound the number of subdomains Av; so that 
the largest diameter of Av; should approach zero.* If the function 
f(x, y, z) is continuous, sums of type (1) will have a limit. This 
limit is to be understood in the same sense as for the definition 
of the double integral.** It is not dependent either on the manner 
of partitioning the domain V or on the choice of points P;; it is designated 
by the symbol (Sf f(P)do and is called a triple integral. Thus, 

V 
by definition, 


lim $7 (P;) Av; = f È § f (P) do 


diam Av; > 0 v 
or 
JSS F(P)do= SSS Fe. y, 2) dxdydz (2) 


If f(x, y, 2) is considered the volume density of distribution of 
a substance over the domain V, then the integral (2) yields the 
mass of the entire substance contained in V. 


2.12 EVALUATING A TRIPLE INTEGRAL 


Suppose that a spatial (three-dimensional) domain V bounded 
by a closed surface S possesses the following properties: 

(1) every straight line parallel to the z-axis and drawn through 
an interior (that is, not lying on the boundary S) point of the 
domain V cuts the surface S at two points; 

(2) the entire domain V is projected on the xy-plane into a 
regular (two-dimensional) domain D; 

(3) any part of the domain V cut off by a plane parallel to any 
one of the coordinate planes (Oxy, Oxz, Quyz) likewise possesses 
Properties 1 and 2. 


* The diameter of a subdomain Av; is the maximum distance between points 
lying on the boundary of the subdomain. 

** This theorem of the existence of a limit of integral sums (that is, of 
the existence of a triple integral) for any function continuous in a closed 
domain V (including the boundary) is accepted without proof. 
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We shall call the domain V that possesses the indicated proper- 
ties a regular three-dimensional domain. 

To illustrate, an ellipsoid, a rectangular parallelepiped, a tet- 
tahedron, and so on are examples of segular three-dimensional 
domains. An instance of an irregular three-dimensional domain is 
given in Fig. 83. In this section we will consider only regular 
domains. 

Zz Z=W/(2,Y) 


ln 


yr giz) 


gry, (2) 


Fig. 83 Fig. 84 


Let the surface bounding V below have the equation z= y (x, y), 
and the surface bounding this domain above, the equation z= p(x, y) 
(Fig. 84). 

We introduce the concept of a threefold iterated integral /,, 
over the domain V, of a function of three variables f(x, y, z) 
defined and continuous in V. Suppose that the domain D is the 
projection of the domain V onto the xy-plane bounded by the curves 


y=9, (x), y=, (xX), x=a, x=b 


Then a threefold iterated integral of the function f(x, y, z) over 
V is defined as follows: 


bT os (x) (Y (x, y) 
w=5| f ( f F(x, y, ode} ay fa (1) 


a Ls (x) \x (x, y) 


We note that as a result of integration with respect to z and 
substitution of limits in the braces (inner brackets) we get a func- 
tion of x and y. We then compute the double integral of this 
function over the domain D as has already been done. 

The following is an example of the evaluation of a three- 
fold iterated integral. 
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Example 1. Compute the threefold iterated integral of the function 

f (x, y, 2)=xyz over the domain V bounded by the planes 
x=0, y=0, z=0, x+y+z=1 

Solution. This domain is regular, it is bounded above and below by the 
planes z=0 and z=1—x—y and is projected 
on the xy-plane into a regular plane domain D, 
which is a triangle bounded by the straight lines 
x=0, y=-0, y=1—x (Fig. 85). Therefore, the 
threefold iterated integral Jy is computed as fol- 


lows: 
l-x-y 
ly= S | f xyz dz |e 
D 0 


Setting up the limits in the twofold iterated in- 
tegral over the domain D, we obtain 


z=l—-x-y 
a) dx 


2=0 


Let us now consider some of the properties of a threefold iterated 
integral. 

Property 1. /f a domain V is divided into two domains V, and 
V, by a plane parallel to one of the coordinate planes, then the 
threefold iterated integral over V is equal to the sum of the three- 
fold iterated integrals over the domains V, and V,. 

The proof of this property is exactly the same as that for 
twofold iterated integrals. We shall not repeat it. 

Corollary. For any kind of partition of the domain V into a 
finite number of subdomains V,, ..., V, by planes parallel to the 
coordinate planes, we have the equality 


Iy=ly,+lv,+.-.. +Iv, 


Property 2 (Theorem on the evaluation of a threefold iterated 
integral). /f m and M are, respectively, the smallest and largest 
values of the function f(x, y, z) in the domain V, we have the 
inequality 


m<ly<MV 


where V is the volume of the given domain and Iy is a threefold 
iterated integral of the function f(x, y, z) over V. 
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Proof. Let us first evaluate the inside integral in the iterated 


¥ (x, y) 
integral r= Sf] f f(x, y, ade | doe 


D Lxx, y) 
(x. y) p(x, y) Y (x, y) p(x, y) 
| Fœ y, 2dze< | Mdz=M Í dz=Mz 
X (x, y) % (xX, y) % (x y) x (x, y) 


=M [b (x, yy—x(% y] 


Thus, the inside integral does not exceed the expression M [1p (x, y)— 
— x(x, y)]. Therefore, by virtue of the theorem of Sec. 2.1 on 
double integrals, we get (denoting by D the projection of the 
domain V on the xy-plane) 


w(x, y 
= fff i F y, ade |do< ff mtv Y—x(%, y)]do 
x (% v) 
=m] [p (x, y)—x (x, y)] do 


But the latter iterated integral is equal to the double integral of 
the function p(x, y)—x (x, y) and, consequently, is equal to the 
volume of the domain which lies between the surfaces z = x(x, y) 
and z= (x, y), that is, to the volume of the domain V. There. 


fore, 
Iy s MV 


It is similarly proved that IyæmV. Property 2 is thus proved. 

Property 3 (Mean-value theorem). The threefold iterated integ- 
ral ly of a continuous function f(x, y, z) over a domain V is equal 
to the product of its volume V by the value of the function at some 
point P of V; that is, 


b (Pix) FH (x, y) 
Iy= [ f(x. y, ade |a} d= (EVV (2) 


1 (x) L (x, y) 


a 


The proof of this property is carried out in the same way as that 
for a twofold iterated integril [see Sec. 2.2, Property 3, formula (4). 
We can now prove the theorem for evaluating a triple integral. 

Theorem. The triple integral of a function f(x, y, z) over a 
regular domain V is equal to a threefold iterated integral over the 
same domain; that is, 


e na 
610 re u gaf E [E tees v adla} a 


PLX (w y) 
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Proof. Divide the domain V by planes parallel to the coordi- 
nate planes into n regular subdomains: 


Av,, Av,, ..., Av, 


As done above, denote by Jy the threefold iterated integral of 
the function f(x, y, z) over the domain V, and by Zay, the three- 
fold iterated integral of this function over the subdomain Auv,. Then 
by the corollary of Property 1 we can write the equation 


Ty = Tax, +1 ao, + ++ H Laon (3) 
‘We transform each of the terms on the right by formula (2): 
Ty =F (P,) Av, + F (P2) Avs +... + F (Px) Aen (4) 


where P; is some point of the subdomain Av;. 

On the right side of this equation is an integral sum. It is 
assumed that the function f(x, y, z) is continuous in V; and for 
this reason the limit of this sum, as the largest diameter of Av; 
approaches zero, exists and is equal to the triple integral of the 
function f(x, y, z) over V. Thus, passing to the limit in (4), as 
diam Av;—-0, we get 


y=S\V Fu, y 2a 


Vv 
or, finally, interchanging the expressions on the right and left, 


Ps (x) l (x, y) 


f(x, y, 2) az| a) dx 


v Loto lace, » 


> ( 
(EEF y 2dv= f} 

a 
Thus, the theorem is proved. 

Here, z= (x, y) and z=% (x, y) are the equations of the sur- 
faces bounding the regular domain V below and above. The lines 
y=, (x), y=, (x), x =a, x=b bound the domain D, which is 
the projection of V onto the xy-plane. 

Note. As in the case of the double integral, we can form a three- 
fold iterated integral with a different order of integration with 
respect to the variables and with other limits, if, of course, the 
shape of the domain V permits this. 

Computing the volume of a solid by means of a threefold ite- 
rated integral. If the integrand f(x, y, z)=1, then the triple 
integral over the domain V expresses the volume of V: 


V= | {| dxdydz (5) 


V 
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Example 2. Compute the volume of the ellipsoid 


Solution. The ellipsoid (Fig. 86) is bounded below by the surface z= 


— yz 2 
=—c V 1-5-5: and above by the 


— a p 
surface ey ioe. The pro- 
jection of this ellipsoid on the xy-plane 
2 42 
(domain D) is an ellipse, t= 1, 


Hence, reducing the computation of vo- 
lume to that of a threefold iterated 


integral, we obtain 


a 
v=f f dz | dy | dx 
TL Oe yoa 
[Ve 
set) fe eee 
TESE 1- = 


When computing the inside integral, x is held constant. Make the substitution: 


2 2 
y=b V 1—žŽ;sint, dy=b V 1—3 cost at 
2 2 
The variable y varies from —b V Iž tob V/ 1-5, therefore ¢ varies 


from -2 to >: Putting new limits in the integral, we get 


a 
2 2 3 
v=x (| f V 01-4)- (1-3) ane b Y 1-4 cost di | 
é a a a 
-4 n 
7? 
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Hence, 
V=4 nab 
=F nabe 
If a=b=c, we get the volume of the sphere: 
4 
‘= na? 


2.13 CHANGE OF VARIABLES IN A TRIPLE INTEGRAL 


1. Triple integral in cylindrical coordinates. In the case of cy- 
lindrical coordinates, the position of a point P in space is deter- 
mined by three numbers 9, p, z, where @ and p are polar coordinates 
of the projection of the point P on the xy-plane and z is the 
z-coordinate of P, that is, the dis- 
tance of the point to the xy. 


Fig. 87 Fig. 88 


plane—with the plus sign if the point lies above the xy-plane, 
and with the minus sign if below the xy-plane (Fig. 87). 

In this case, we divide the given three-dimensional domain V 
into elementary volumes by the coordinate surfaces 82=0,, p=p;, 
z==z, (half-planes adjoining the z-axis, circular cylinders whose 
axis coincides with the z-axis, planes perpendicular to the z-axis). 
The curvilinear “prism” shown in Fig. 88 is a volume element. 
The base area of this prism is equal, to within infinitesimals of 
higher order, to pA@ Ap, the altitude is Az (to simplify notation 
we drop the indices i, j, k). Thus, Auv=pA@Ap Az. Hence, the 
niple integral of the function F (0, p, z) over the domain V has 

e form 


1=S{l Fe, p, z) p dð dp dz (1) 


The limits of integration are determined by the shape of the 
domain V. 
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If a triple integral of the function f(x, y, z) is given in rectan- 
gular coordinates, it can readily be changed to a triple integral 
in cylindrical coordinates. Indeed, noting that 

x=pcos0, y=psinO, z=z 
we have 
(VS F(x, y, z)dxdydz= Í Í $ F (0, p, 2)p d0 dp dz 
V V 
where 
f(pcos@, psinð, z)=F (b, p, 2) 

Example. Determine the mass M of a hemisphere of radius R with centre 
at the origin, if the density F of its substance at each point (x, y, z) is pro- 
portional to the distance of this point from the base, that is, F =kz. 

Solution. The equation of the upper part of the hemisphere 

z= VRA 


in cylindrical coordinates has the form 


z= VR*— i 
Hence, 
2AF R VR -p° 
M= Í È È kzp dð dpaz= Í [S f trae) p ap |as 
-0 0 0 
VR- p° Qn 


I 
otl x 
n =< 


2. Triple integral in spherical coordinates. In spherical coor- 
dinates, the position of a point P in space is determined by three 
numbers, ©, r, ọ, where r is the distance of the point from the 
origin, the so-called radius vector of the point, ọ is the angle 
between the radius vector and the z-axis, @ is the angle between 
the projection of the radius vector on the xy-plane and the x-axis 
reckoned from this axis in a positive sense (counterclockwise) 
(Fig. 89). For any point of space we have 


0<r<o, Kps; OKOS 2n 


Divide the domain V into volume elements Av by the coordi- 
nate surfaces r = const (spheres), ọ = const (conic surfaces with ver- 
tices at origin), 0= const (half-planes passing through the z-axis). 
To within infinitesimals of higher order, the volume element Av 
may be considered a parallelepiped with edges of length Ar, rAgq, 
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rsing A0. Then the volume element is equal (see Fig. 90) to 
Av=r* sing Ar A8 Ap 
The triple integral of a function F (0, r, p) over a domain V has 
the form 
1=\\{ F0, r, 9) sing dr do dp (1) 
Vv 


The limits of integration are determined by the shape of the 
domain V. From Fig. 89 it is easy to establish the expressions of 


Fig. 89 Fig. 90 


Cartesian coordinates in terms of spherical coordinates: 
x=rsingcos@ 
y =r sing sinð 
z=r coso 


For this reason, the formula for transforming a triple integral from 
Cartesian coordinates to spherical coordinates has the form 


DUG y, z) dx dy dz 
=f |f f [rsingcoso, rsing sine, r cosg] rsin pdr dð dg 
V 


3. General change of variables in a triple integral. Transforma- 
tions from Cartesian coordinates to cylindrical and spherical coor- 
dinates in a triple integral represent special cases of the general 
transformation of coordinates in space. 

Let the functions 

x=ọ (u, t, w) 
y=Ņ (u, t, w) 
z=y(u, t, w) 
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map, in one-to-one manner, a domain V in Cartesian coordinates 
x, y, z onto a domain V’ in curvilinear coordinates u, t, w. Let 
the volume element Av of V be carried oyer to the volume element 
Av’ of V’ and let 


lim aor =I 
Then 
IAS Fe, y, z)dxdy dz 
= SfN F lp tu, t, w), p(u, t, w), y(u, t, w)] |T |du dt dw 


As in the case of the double integral, Z is called the Jacobian; 
and as in the case of double integrals, it may be proved that the 
Jacobian is numerically equal to a determinant of order three: 

Ox Ox Ox 
ðu Ot ðw 
[== |2% 98 Oy 
~ | ðu ðt dw 
ðz Oz Oz 
ðu Of ðw 
Thus, in the case of cylindrical coordinates we have 
x= pcos, y=psinð, z=z (p=u, 0=t, z=w) 
cosð —psin@ 0 


sin@ pcosé 0 
0 0 l 


In the case of spherical coordinates we have 


T= =p 


x=rsingcosð, y=rsingsin®, z=rcosọ (r=u, p=t, 0=w) 


singcos@ rcosọcos® —rsingsin® 
T=|singsin® rcos@sin® r sin pcos ® | =r? sing 
cos p —rsing 0 


2.14 THE MOMENT OF INERTIA AND THE COORDINATES 
OF THE CENTRE OF GRAVITY OF A SOLID 


1. The moment of inertia of a solid. The moments of inertia 
of a point M(x, y, z) of mass m relative to the coordinate axes 
Ox, Oy and Oz (Fig. 91) are expressed, respectively, by the formulas 

T= (y2 +2?) m 
Ty =? +2*) m, Izz = (x° -+4°) m 
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The moments of inertia of a solid are expressed by the corre- 
sponding integrals. For instance, the moment of inertia of a 
solid relative to the z-axis is expressed by the integral /,,= 


= SSS e+) v(x, Y, z)dxdydz, where y(x, y, z) is the density 
V 
of the substance. 


Example 1. Compute the moment of inertia of a right circular cylinder of 
altitude 2h and radius R relative to the diameter of its median section, consi- 
dering the density constant and equal to yp. 

Solution. Choose a coordinate system as 
follows: direct the z-axis along the axis of 
the cylinder, and put the origin of coordi- 
nates at its centre of symmetry (Fig. 92). 


Fig. 91 Fig. 92 


Then the problem reduces to computing the moment of inertia of the cy- 
linder relative to the x-axis: 


Lax = È È È (92+ 2?) Yo dx dy dz 
V 


Changing to cylindrical coordinates, we obtain 


2n (Rf h 
I xx= Yo f ( f (2? + p? sin? 6) a | | dð 
0 0 Lh 
T (¢ 2h3 ai 2h3 R? ARå 
=v | i) [ 5 + 2h0# sin? 6 | pan) d0— yo È Ea R+ a sinto} ao 
0 to 5 


"2h R? 2hR+ | T2 2 
=Yo Es an + n| = vor? | m+] 


2. The coordinates of the centre of gravity of a solid. Like what 
we had in Sec. 12.8, Vol. I, for plane figures, the coordinates of 
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the centre of gravity of a solid are expressed by the formulas 


JS vce 2) de dy de (SS vr y, 2) dx dy de 
8 are ea Y 
A iire y, z) dx dy dz Ce (ire y, z) dx dy dz 
v v 


{NS eve, y, 2) dx dy dz 
_ Vv 
ce {Sf ve, y, z) dx dy dz 
V 
where y(x, y, z) is the density. 


Example 2. Determine the coordinates of the centre of gravity of the upper 
half of a sphere of radius R with centre at the origin, assuming the density yo 
constant. 

Solution. The hemisphere is bounded by the surfaces 

z= VRAJ, z=0 
The z-coordinate of its centre of gravity is given by the formula 


Jff masave 


Sf vode a a 


Changing to aii coordinates, we get 


Fl 


| (vode dyas 


2n EI R \ 
f f (cos grësin gar ) ao dð nPE L 
PORA ò \o e A 2 3R 
c 4 8 
Qa = mR 


TE 
2 6 
v | f | asimpar dọ | d0 
0 
Obviously, by virtue of the symmetry of the hemisphere, +, =y,=0. 
2.15 COMPUTING INTEGRALS DEPENDENT 
ON A PARAMETER 


Consider an integral dependent on the parameter a: 
b 
I (a) = Í f (x, a)dx 
a 


(We examined such integrals in Sec. 11.10, Vol. I.) We state with- 
out proof that if a function f(x, œ) is continuous with respect to 


14---2082 
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x over an interval [a, b] and with respect to æ over an interval 
[a,, a], then the function 


b 
I (a) = | f(x, a)dx 
a 
is a continuous function on [a,, &.]. Consequently, the function 
I (a) may be integrated with respect to a over the interval [a,, o.]: 


Qs af b 
| 1 (a) da = § [re a) dr | da 
ay a, La 

The expression on the right is an iterated integral of the function 
f(x, æ) over a rectangle situated in the plane xOa. We can change 
the order of integration in this integral: 


asf b ofa, 
f |S re aarja = $f f(x, oy daa 


a, La a 

This formula shows that for integration of an integral dependent 
on a parameter a, it is sufficient to integrate the element of 
integration with respect to the parameter a. This formula is also 
useful when computing definite integrals. 


Example. Compute the integral 


dx (a>0, b>0) 


oa 
e- ax —e-bx 
a 


This integral is not expressible in terms of elementary functions. To evaluate 
it, we consider another integral that may be readily computed: 


oO 
-Qx 81 
f e7 ** dx = z (a > 0) 
0 
Integrating this equation between the limits a=a and a =b, we get 


bf ax b 

ifi nearen fom 2 
a a 

a tO a 


Changing the order of integration in the first integral, we rewrite this equation 


in the following form: 
œ b 
{| fee ia |ant 


0 La 
whence, computing the inner integral, we get 


—ax _ e- Ox 
(eee 
a 
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Exercises on Chapter 2 


Evaluate the integrals: * 


12 Š 42 ETAN 96 2xV3 
2 — = . . 
1. {fo + y*) dx dy. Ans. 5 2f EE . Ans. Ingg- 3 f f xy dx dy 
01 31 I x 
2n a ax T ; 
15 la i x dy Ta i 
Ans. 7. 4. f f r dr dð. Ans. -y na®. 5. J) EF: Ans. | aarctan =. 
0 asin® 0 x 
a 
a 2y b x/2 
llat 3 
6. xy dx dy. Ans. a: 7. p dð dp. Ans. g” 
0 y-a b 0 
2 


Determine the limits of integration for the integral f | Fe, y)dxdy where 
the domain of integration is bounded by the lines: 


5 
8. x=2, x=3, y= —1, y=5. Ans. f f F(x, y)dy dx. 9. y==0, y=1 —x?. 
2-1 


1 1—x* a Vat-x 
Ans. f f f(x, y)dydx. 10. x?+y%=at, Ans. f f f(x, y)dy dx. 
-1 0 -a „Vax 
2 
2 1 14x3 
il. y= TFA’ y=x?. Ans. f f f (x, y) dy dx. 12. y=0, y =a, y =x, 
ay+2a ae 
y=x—2a. Ans. f f f(x, y)dx dy. 
Oo y 
Change the order of integration in the integrals: 
24 42 1Vx 
13. f (re, y) dy dx. Ans. | | F, y)dx dy. 14. f f f (x, y) dy dx. Ans. 
gaa 3 i ò x 
1 yu u V 2ay—y* a a 
f { f(x, y)dx dy. 15. f \ f(x, y) dx dy. Ans. f f F(x, y)dydx. 
oy 0 0 0 ag-Var—x 


NL 
* If the integral is written as f f F(x, y)dxdy then, as has already been 


MK 
stated, we can consider that the first integration is performed with respect to 
the variable whose differential occupies the first place; that is, 


N L N /L 
| [Fe ydedy= f (fre wae ay 
M K M NK 


212 Ch. 2 Multiple Integrals 


1 VI-t 1 Vi-ys 
16. f f f (x, y) dy dx. Ans. f f f (x, y) dx dy. 
-1 0 OL Vi-y* 
1 lay o Vi-x ll-x 
17. ( È Fe, yydedy. Ans. € È fi, ydyde+| È Fe, y)dy de. 
0 -vij -1 0 0 0 
Compute the following integrals by changing to polar coordinates: 
T 
aVat- x3 Z a 
18. f f V a — 2 —¥? dy dx. Ans. f f V a@— p? p dp d0== a, 
0 0 0 0 
ELS 
aVat-y? 2 a í oo 
19. | ( (x?-+ y2) dx dy. Ans. J È dpa. 20. f emeta ay de. 
o 0 00 00 
1 
2 2a V 2ax—at 2a cos 0 


ELI 
w T 
2 
Ans. f feep dp d=5 . 21. f f dy dx. Ans. f f p dp dd=——. 
0 0 0 0 


Transform the double integrals by introducing new variables u and v connece 
ted with x and y by the formulas x=u—uv, y= uv: 


B e 
e Bx TEB I+u c b 
22. f Vie, y) dy dx. Ans. f f f (u—uv, uv) u du dv. 23. f fre, y) dy dx. 
0 ax a 0 00 
l+a 
c gb: 


b v 

f (u—uv, uv) u du dv+ f Vj u—uo, uv) u du dv. 
b 0 
b+c 


Calculating Areas by Means of Double Integrals 

24. Compute the area of a figure bonnded by the parabola y2=2x and the 
straight line y =x. Ans. 4. 

25. Compute the area of a figure bounded by the curves y?=4ax, x-+y=3a, 
y=0. Ans. Ra. 

26. Compute the area of a figure bounded by the curves x!/? -+ y1? =a"?, 
x+y=a. Ans. =a 

27. Compute the area of a figure bounded by the curves y=sinx, y=cosx, 
x=0. Ans. V2—1. 

28. Compute the area of a loop of the curve p =a sin 20. Ans. aa 3 


8 
29. Compute the entire area bounded by the lemniscate p? =a? cos 2p. Ans. a. 
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2xy 


2 
30. Compute the area of a loop of the curve (4 ori gr y j= a 


2b2 
Hint. Change to new variables x= pa cos 0 anê y= pb sin. Ans. e s 


Calculating Volumes 
31. Compute the volumes of solids bounded by the following surfaces: 
ž4# +=, x=0, y=0, z=0. Ans. ~, 32. z=0, x?-+y®=1,x+y+ 
+2=3. Ans. 3n. 33. (x—1)?-+(y—1)?=1, xy =z, z=0. Ans. n. 34. x? -L y? — 
—2ax=0, z=0, x?+y?=2?. Ans. 7. 35. y=x?, x=y?, z=0, z=12+y—x?. 


549 
Ans. Ta: 


36. Compute the volumes of solids bounded by the coordinate planes, the 
plane 2x-+3y—12=0 and the cylinder z= yt Ans. 16. 


37. Compute the volumes of solids bounded by a circular cylinder of radius a, 

ee axis coincides with the z-axis, the coordinate planes and the plane 
a 4 3 

E onik the volumes of solids bounded by the E xt y=a?, 


x2? +z? =Q. Ans. Pat. 39. y2+22=x,x=y,z=0. Ans. = + 40. x?-++ y?+22= 
=a?, x2-+y?=R?, a > R. Ans. Í a [e (VEZ R?)?]. 41. az =x? 4 y?, 


z=0, x2? + y2=2ax. Ans. 3 na. 42. p?=a? cos 20, x?-+y?+2%=a?, z=0. 
(Compute the volume that is interior with respect to the cylinder.) 


Ans. S a (3n + 20—16 V 2). 


Calculating Surface Areas 
43. Compute the area of that part of the surface of the cone x?-b y? = z2 


which is cut out by the cylinder x?-+ y? =2ax. Ans. 2na? V 2. 
44. Compute the area of that part of the plane x-+y+z-=2a which lies in 
the first octant and is bounded by the cylinder x?-+ y2=a?. Ans. a V3 
45. Compute the surface area of a spherical segment (minor) if the radius of 
the sphere is a and the radius of the base of the segment isb. 


Ans. 2n (a? —a V a?— 62). 
46. Find the area of that part of the surface of the apts 5 yY +z = 


which is cut out by the surface of the cylinder 5+ =l or 


2 
Ans. 4na?— 8a? arcsin re 


47. Find the surface area of a solid that is the common part of two cylin- 
ders x? + y2?=a?, y2+2z2=a?. Ans. 16a?. 

48. Compute the area of that part of the surface of the cylinder x? + y? = 2ax 
which lies between the plane z=0 and the cone x2-+ y?==z?. Ans. 8a?. 

49. renee the area of that part of the surface T the cylinder x? + y? =a? 

which lies between the plane z= mx and the plane z=0. Ans. 2ma?. 
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50. Compute the area of that part of the surface of the paraboloid y? -+ z? = 2ax 
which lies between the parabolic cylinder y?=ax and the plane x=a. 


Ans. = na (3 V 3—1). 


Computing the Mass, the Coordinates of the Centre of Gravity, 
and the Moment of Inertia of Plane Solids 
(In Problems 51-62 and 64 we consider the surface density constant and 
equal to unity.) 


51. Determine the mass of a lamina in the shape of a circle of radius a if 
the density at any point P is inversely proportional to the distance of P from 
the axis of the cylinder (the proportionality factor is K). Ans. 2nak. 

52. Compute the coordinates of the centre of gravity of an equilateral triangle 
if we take its altitude for the x-axis and the vertex of the triangle for the 
coordinate origin. Ans. pe ay y=0. 

53. Find the coordinates of the centre of gravity of a circular sector of radius a, 
taking the bisector s its angle as the. x-axis. The angle of spread of the sector 

asin a 


is 2a. Ans. *c=—3q? ¥c=0. 
54. Find the coordinates of the centre of gravity of the upper half of the 
circle x?-++y?=a?. Ans. xc=0, yo=ae. 


55. Find the coordinates of the centre of gravity of the area of one arch of 
the cycloid x=a(t—sin?t), y =a (1 —cces t). Ans. xc=an, v=. 
56. Find the coordinates of the centre of gravity of the area bounded by a 


loop of the curve p? =a? cos 20. Ans. re ta V2 


» Yc=0. 
57. Find the coordinates of fhe centre of gravity of the area of the cardioid 
5a 
p=a(l-+cos®). Ans. xc==, yo=0. 


58. Compute the moment of inertia of the area of a rectangle bounded by the 
ab (a? +b?) 
E 


2 2 
59. Compute the moment of inertia of the ellipse Sth: (a) relative 


straight lines x=0, x =a, y=0, y=b relative to the origin. Ans. 


3 
Tae o) T (ato, 


60. Compute the moment of inertia of the area of the circle p= 2a cos 6 


to the y-axis; (b) relative to the origin. Ans. (a) 


relative to the pole. Ans. 3 nat. 


61. Compute the moment of inertia of the area of the cardioid p =a (1 — cos 8) 


4 
relative to the pole. Ans. cone 


62. Compute the moment of inertia of the area of the circle (x —a)?+ (y — b)?= 
= 2a? relative to the y-axis. Ans. 3na‘. 

63. The density at any point of a square lamina with side a is proportional 
to the distance of this point from one of the vertices of the square. Compute 
the moment of inertia of the lamina relative to the side passing through this 


vertex. Ans. pti [7 V 2+31In(V 2+1)], where k is the proportionality 
factor. 
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64. Compute the moment of inertia of the area of a figure, bounded by the 


parabola y2=ax and the straight line x =a, relative to the straight line y = —a. 
Ans. z% x 
Triple Integrals 
65. Compute EEEren if the domain of io i bounded 
by the coordinate planes and the plane x+y +z=1. Ans. TOR 


0 Lo \o 
67. Compute the volume of a solid bounded by the sphere x?+ y?+283=4 


and the surface of the paraboloid x24- y2=3z. Ans. Et 


arx,y 
6 
66. Evaluate f f (f xyz i) 7 dx. Ans. ze: 


68.* Compute the coordinates of the centre of gravity and the moments of 
inertia of a pyramid bounded by the planes x=0, y=0, z=0, =4+$42— 1. 


a b c abc bac cab abe 
Ans.xc=Gido= Ge tcH Zi lx= Gye y= Goo le= GO lo= EG (G+ 


+ b%-+-c2). 
69. Compute the moment of inertia of a circular right cone relative to its 


axis. Ans. thet, where h is the altitude and r is the radius of the base of 


the cone. 
70. Compute the volume of a solid bounded by a surface with equation 


(x? y?-+ 22)? =a5x. Ans. x na’, 
71. Compute the moment of inertia of a circular cone relative to the diameter 
of the base. Ans. MT (2h? +37). 


72. Compute the coordinates of the centre of gravity of a solid lying between 
a sphere of radius a and a conic surface with angle at the vertex 2a, if the 
vertex of the cone coincides with the centre of the sphere. Ans. xc=0, yc=0, 


zc=%a(1+cos a) (the z-axis is the axis of the cone, and the vertex lies at 
the origin). 

73. Compute the coordinates of the centre of gravity of a solid bounded by 
a sphere of radius a and by two planes passing through the centre of the sphere 
and forming an angle of 60°. Ans. p= % 6=0, g= > (the line of inter- 


section of the planes is taken for the z-axis, the centre of the sphere for the 
origin; p, 8, @ are spherical coordinates). 
oe 


74. Using the equation => | e7 @* da (a>0), compute the integrals 
n 
0 


I 
Ve 
œ 


œ 
(ss xde og f sinxdx 4 ae Vs: 
| v l y: AN Fi 7: 


* In Problems 68, 69 and 71 to 73 we consider the density constant and 
equal to unity. 


CHAPTER 3 


LINE INTEGRALS AND SURFACE INTEGRALS 


3.1 LINE INTEGRALS 


Let a point P(x, y) be in motion along some plane curve L 
from the point M to the point N. To P is applied a force F which 
varies in magnitude and direction with the motion of P; it is thus 

i some function of the coordinates 
of P: 


F=F (P) 


Let us compute the work A ot 
the force F as the point P is tran- 
slated from M to N (Fig. 93). To 
do this, we divide the curve MN 
into n aD a parts by the points 
M=M,, M, M,, M,=N in 
the E from M ‘to N and we 
denote by As; the vector M;M;,,. 
J é Ne We denote by F; the magnitude of 

Ti Titti “ the force F at the point M;. Then 
Fig. 93 the scalar product F;As; may be 
regarded as an approximate expres- 
sion of the work of the force F along the arc M;M;.4;: 


A; ~ F,As; 


F=X (x, yi +Y (x, yj 
where X (x, y) and Y (x, y) are the projections of the vector F on 
the x- and y-axes. Denoting by Ax; and Ay; the increments of the 
coordinates x; and y; when changing from the point M; to the 
point M;,,, we get 


Let 


As; = Axji+ Ay,J 


F;As;= X (xi yi) Ax; +Y (xis Yi) Ay; 


The approximate value of the work A of the force F over the 
entire curve MN will be 


A ~ BP As, = 2 [X (xi yi) Ax; +Y (xi y;) Ay] (1) 


Hence, 
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Without making any precise statements, we shall say that if 
the expression on the right has a limit as As; -> 0 (here, obviously, 
Ax; -+0 and Ay; — 0), then this limit expresses the work of the 
force F over the curve L from the point M to the point N: 


n 


A= lim > [X (x; yj) Ax; +Y (xi y;) Ags] (2) 


Ax, +0 f=) 
dy, 0 


The limit* on the right is called the line integral of X (x, y) and 
Y (x, y) along the curve L and is denoted by 


A=\X(e, y)dx+Y (x, y)dy (3) 
or 
(N) 
A= | X(x, y)dx+Y (x, y)dy (3’) 
(M) 


Limits of sums of type (2) frequently occur in mathematics and 
mechanics; here, X (x, y) and Y (x, y) are regarded as functions of 
two variables in some domain D. 

The letters M and N, which take the place of the limits of 
integration, are in brackets to signify that they are not numbers 
but symbols of the end points of the curve over which the line 
integral is taken. The direction along the curve L from M to N 
is called the sense of integration. 

If the curve L is a space curve, then the line integral of three 
functions X (x, y, z), Y (x, y, z), Z(x, y, z) is defined similarly: 


| X(x, y, z)dx+Y (x, y, zdy+Z(x, y, z)dz 


L 


im. DX (Kes Yrs Za) AX +Y (Xrs Yrs Ze) AYk +Z (Xr Yor Ze) Azp 
> Ukzl 
an +0 
Az, ~0 
The letter L under the integral sign indicates that the integration 
is performed along the curve L. 
We note two properties of a line integral. 
Property 1. A line integral is determined by the element of in- 
tegration, the form of the curve of integration, and the sense of 


integration. 


* Here, the limit of the integral sum is to be understood in the same sense 
as in the case of the definite integral, see Sec. 11.2 (Vol. I). 
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A line integral changes sign when the sense of integration is 
reversed, since in that case the vector As and, hence, its projec- 
tions Ax and Ay, change sign. 

Property 2. Divide the curve L by the point K into pieces L, 
and L, so that MN = MK +KN (Fig. 94). Then, from formula (1) 
it follows directly that 


(N) (K) (N) 
| Xdx+Y dy= A Xdx+Ydy+ J Xde+Y dy 
(M) 


This relation holds for any number of ene 
It will further be noted that the definition of a line integral holds 
true also for the case when the curve L is closed. 
In this case, the initial and terminal points of the curve coin- 
cide. Therefore, in ie case of a closed curve we cannot write 
N) 


la xae4Vdgy bit only | Kae Vd and 


L 
we have to indicate the direction of circu- 
lation (sense of description) over the closed 
curve L. The line integral over a closed con- 
M tour L is frequently denoted also by the 


Fig. 94 symbol $ Xdx+Y dy. 


L 
Note. We arrived at the concept of a line integral while consi- 
dering the problem of the work of a force F on a curved path L. 
Here, at all points of the curve L the force F was given as a 
vector function F of the coordinates of the point of application 
(x, y); the projections of the variable vector F on the coordinate 
axes are equal to the scalar (numerical, that is) functions X (x, y) 


and Y (x, y). For this reason, a line integral of the form f X dx +Y dy 
L 

may be regarded as an integral of the vector function F given by 

the projections X and Y 


The integral of a vector function F along a curve L is denoted 
by the symbol 


f F ds 
L 


If the vector F is defined by its projections X, Y, Z then this 
integral is equal to the line integral 


| Xdx+Ydy+Zdz 
L 


As a particular instance, if the vector F lies in the xy-plane, then 


3.2 Evaluating a Line Integral 219 


the integral of this vector is equal to 


| Xdx+Y dy e 
L 


When the line integral of a vector function F is taken along a 
closed curve L, this line integral is also called a circulation of the 
vector F over the closed contour L. 


3.2 EVALUATING A LINE INTEGRAL 


In this section we shall make more precise the concept of the 
limit of the sum (1) of Sec. 3.1 and in this connection we shall 
make more precise the concept of the line integral and indi- 
cate a method for calculating it. 

Let a curve L be represented by equations in parametric form: 


x=ọ (t), y=(t) 


Consider the arc of the curve MN (Fig. 95). Let the points M 
and N correspond to the values of the parameter a and f. Divide 
the arc MN into subarcs As; by the 
points M, (xis Y)» M, (2, Y2), aa | 
M, (Xns Yn)» and put x; = (t;), Yi = 
=p (t 


Y (2;). 
Consider the line integral 


(X(x, y)dxt+ V(x, dy (1) 


L 


defined in the preceding section. We 0 
give without proof the existence theo- Fig. 95 

rem of a line integral. /f the fun- 

ctions p(t) and w(t) are continuous and have continuous derivatives 
g’ (t) and p’ (t), and also continuous are the functions X [9 (t), p(t)] 
and Y [p(t), p(t)] as functions of t on the interval [a, na then the 
following limits exist: 


lim $X &, y) Ax; =A 
Pa 


Ax, +0 


ten, setae 1S (2) 
lim DY i yi) Ay; = B f 
i=l 


ây; >0 


where x; and y; are the coordinates of some point lying on the arc 
As;. These limits do not depend on the way the arc L is divided into 
subarcs As;, provided that As; — 0, and do not depend on the choice 


of the point M;(X;, y;) on the subarc As;; they are called line 
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integrals and are denoted as 
(2’) 
B= f Y (x, y)dy 


Note. From this theorem it follows that the sums defined in the 
preceding section, where the points M; (x;, y;) are the extremities 
of the subarc As; and the manner of partition of the arc L into 
subarcs As, is arbitrary, approach the same limit —the line integral. 

This theorem makes it possible to develop a method for com- 
puting a line integral. 

Thus, by definition, we have 

(N) F _ 

| X(x, yd = lim SX Gi Y) Ax; (3) 

(M) bx, +0 fy 
where 

AX; = X;—X;-1= P (t;) —@ (ti-1) 
Transform this latter difference by the Lagrange formula 
Ax; =9 (ti) — 9 (tiz) =P (T) (ti—ti-1) =" (T) At; 

where qt; is some value of ¢ that lies between the values ¢;_, and ¢,. 


Since the point x,, y; on the subarc As; may be chosen at plea- 
sure, we shall choose it so that its coordinates correspond to the 
value of the parameter 1;: 


x= (t), Y= (7) 
Substituting into (3) the values of x; y; and Ax; that we have 
found, we get 


(N) 7 
| X(x, dx= lim SX [p (x) p(x] p (t) At; 
(M) At +0 fo) 


On the right is the limit of the integral sum for the continuous 
function of a single variable X[ọ (£), p(t)] 9’ (t) on the interval [a, B]. 
Hence, this limit is equal to the definite integral of the function: 


(N) B 
| X (x, y)de-=|X[ol), vO] (Hat 
(M) a 
In analogous fashion we get the formula 
(N) B 


(Yi, y)dy = | Y [o (H, pl] v (at 


(M) 
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Adding these equations term by term, we obtain 


(N) B 
f Xe y)dx+Y (x, y)dy = | {X Lot), YOP (t) 
(M) a 
+Y [p (8, p(t)] y’ (f)} de (4) 


This is the desired formula for computing a line integral. 
In similar manner we compute the line integral 


{ Xdx+Y dy+Zdz 


over the space curve defined by the equa- 
tions x= g(t), y= (t), z= (0). 

Example 1. Compute the line integral of three 
functions: x?, 3zy?, —x?y (or, what is the same 
thing, of the vector function x3/+ 3zy2/— x?yk) 
along the straight-line segment from the point 
M (3, 2, 1) to the point N (0, 0, 0) (Fig. 96). 


Fig. 96 Fig. 97 


Solution. To find the parametric equations of the line MN, along which the 
integration is to be performed, we write the equation of the straight line that 
passes through the given two points: 


and denote all these ratios by a single letter ¢; then we get the equations of 
the straight line in parametric form: 


x=3t, y=2t, z=t 
Here, obviously, to the origin of the segment MN corresponds the value of tne 
parameter ¢=1, and to the terminus of the segment, the value £=0. The deri- 


vatives of x, y, z with bg ae to the parameter ¢ (which will be needed for 
evaluating the line integral) are easily found: 


x,=3, y= 2, z=l 
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Now the desired line integral may be computed by formula (4): 


(N) 0 
( x? dx -4+32y% dy —x?y dz = f [(86)3-3 +34 (24)2-2 — (3t)? - 24-1} dt 
(M) 


1 
c 87 
= 3 = — — 
=f sx d==3 
1 


Example 2. Evaluate the line integral of a pair of functions, 6x?y, and 10xy?, 
along a plane curve y =x’ from the point M (1, 1) tothe point N (2, 8) (Fig. 97). 
Solution. To compute the required integral 
(N) 
f 6x?y dx + 10xy? dy 
(M) 
we must have the parametric equations of the given curve. However, the exp- 
licitly defined equation of the curve y =x’ is a special case of the parametric 
equation: here, the abscissa x of the point of the curve serves as the parameter, 
and the parametric equations of the curve are 
x=x, y=% 
The parameter x varies from x,=1 to x,=2. The derivatives with respect to 
the parameter are readily evaluated: 


xl, y =3x° 


Hence, 
(N) 2 2 
f 6x?y dx +10xy?dy=Í [6x2x3 - 1 + 10xx8 -3x2] dx = f (6x5 +. 30x°) dx 
(M) 1 1 


= [x843x10]2 = 3132 


We now indicate certain applications of a line integral. 

1. The expression of the area of a region bounded by a curve 
y in terms of a line integral. In an 
xy-plane let there be given a do- 
main D (bounded by a contour L) 
such that any straight line paral- 
lel to one of the coordinate axes 
and passing through an interior 
point of the domain cuts the boun- 
dary L of the domain in no more 
than two points (which means that 
D is regular) (Fig. 98). 

Suppose that the domain D is 
projected on the x-axis in the 
interval [a, b], andit is bound- 


Fig. 98 
ed below by the curve (4): 
y =y, (x) 
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and above by the curve (4): 
y =y, (x) 
[y (x) <y, (x)]. 
Then the area of the domain D is 


b b 
S= f n, (x)dx— Í n, (x)dx 
a 


a 


But the first integral is a line integral over the curve l, (MPN), 
since y= y, (x) is the equation of this curve; hence, 


b 
(u()dr= f yde 
a MPN 
The second integral is a line integral over the curve l, (MQN), 
that is, ; 
fuc)de= f yde 
a MQN 
By Property 1 of the line integral we have 


| ydr=— J ydr 
MPN NPM 
Hence, 
S=— | ydx— f ydx=— | ydx (5) 
NPM MQN L 


Here, the curve L is traced in a counterclockwise direction. 
If part of the boundary L is the segment M,M, parallel to the 
) 


y-axis, then f ydx=0, and equation (5) holds true in this case 


(M4) 
as well (Fig. 99). 
Similarly, it may be shown that 


S=\ xdy (6) 
i 


Adding (5) and (6) term by term and dividing by 2, we get 
another formula for computing the area S: 


1 
S=5 f xdy—yde (7) 
L 


Example 3. Compute the area of the ellipse 
x=acost, y=bsint 
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Solution. By formula (7) we find 


2n 
s=; | [a cos ¢ b cos £ —b sin £ (— a sin £)] df = nab 
3}. 


We note that formula (7) and formulas (5) and (6) as well hold 
true also for areas whose boundaries are cut in more than two 
points by lines parallel to the coordinate axes (Fig. 100). 

To prove this, we divide the given domain (Fig. 100) into two 
regular domains by the line /*. y l, 


Fig. 99 Fig. 100 


Formula (7) holds for each of these domains. Adding the left and 
right sides, we get (on the left) the area of the given domain, on 
the right, a line integral taken over the entire boundary with 
phe coefficient '/, since the line integral over 
z 22 22 the division line /* is taken twice: in the 
direct and reverse senses; hence, it is equal 
to zero. 
2. Computing the work of a variable 
F=mgk force F on some curved path L. As was 
shown at the beginning of Sec. 3.1, the 
~ Work done by a force F=X (x, y, z) i+ 


T Yy +Y(x, y, z j+Z(x, y, z)R along a line 
Fig. 101 L=MN is equal to the line integral 
(N) 
A= È| X(x, y, z\dx+Y.(x, y, z\dy+Z(x, y, 2)dz 
(M) 


Let us consider an instance that shows how to calculate the work 
of a force in concrete cases. 


Example 4. Determine the work A of the force of gravity F when a mass m 
is translated from the point M, (a1, bı, cı) to the point M3 (a, bz, C2) along 
an arbitrary path L (Fig. 101). 

Solution. The projections of the force of gravity F on the coordinate axes 
are 

X=0, Y=0, Z=— mg 
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Hence, the desired work is 


(Mg) Cy 
A= f X dx+Y dy +Z dz= Í (— mg) dz= mg (c1 —c:) 
(M,) Cy o 


Consequently, in this case the line integral is independent of the path of in- 
tegration and dependent only. on the initial and terminal points. More precisely, 
the work of the force of gravity is dependent only on the difference between 
the heights of the terminal and initial points of the path. 


3.3 GREEN’S FORMULA 


Let us establish a connection between a double integral over 
some plane domain D and the line integral around the boundary L 
of that domain. 

In an xy-plane, let there be given a domain D, which is regu- 
lar both in the direction of the x-axis and the y-axis, bounded by 
a closed contour L. Let the domain be bounded below by the 
curve y=y,(x), and above by the curve y=y,(x), y, (x) <y, (x) 
(axx<b) (Fig. 98). 

Together, both these curves represent the closed contour L. Let 
there be given, in D, continuous functions X (x, y) and Y (x, y) 
that have continuous partial derivatives. We consider the integral 


OX (x, y) 
if <a dx dy 
D 
Representing it in the form of a twofold iterated integral, we find 


ax b y(x) ax b ya (x) 
Sap aedy=S f gule (xt, yy) d 
D ; a y(x) a n (x) 
=f [X (x, n (—X(% v (x)] dx (1) 


We note that the integral 
b 


Í X (x, (x) dx 
a 

is numerically equal to the line integral 
Í X(x, y)dx 
MPN 


taken along the curve MPN, whose equations, in parametric 
form, are 


x=x, Y=Y, (x) 
where x is the parameter. 


15—2082 
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Thus 


b 
(X, n()dr= | X(x, y)dx (2) 
MPN 


a 


Similarly, the integral 
b 


(X(x, y, (9) dx 


a 
is numerically equal to the line integral along the arc MQN: 


b 
[Xi na)de= J X(x, y)dx (3) 
a MQN 
Substituting expressions (2) and (3) into formula (1), we obtain 
ðX 
(f5 drdy= | Xi, pde— | Xea A 
y 
D MPN MQN 


But 
| X(x, ydxe=— | X(x, wax 
MQN NQM 


(see Sec. 3.1, Property 1). And so formula (4) may be written thus: 
ðX 
i S dxdy = f X (x, y)dx+ f X (x, y)dx 
D MPN NQM 


But the sum of the line integrals on the right is equal to the line 
integral taken along the entire closed curve L in the clockwise 
direction. Hence, the last equation can be reduced to the form 


f X dx dy = X (x, y) dx (5) 

D L (in the clockwise sense) 
If part of the boundary is the segment /, parallel to the y-axis, 
then | X (x, y)dx=0, and equation (5) holds true in this case as 


ls 
well. 
Analogously, we find 


oY 
\\Sededy=— | Yi, way (6) 
D L (in the clockwise sense) 
Subtracting (6) from (5), we obtain 
ðX oY 
sf (Z-Z )iiy= f Xdx+Y dy 


L (in the clockwise sense) 
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If the contour is traversed in the counterclockwise sense, then * 
OY Ox 
{A (ge Sy aed J X dety dy 


This is Green’s formula, named after the English physicist and 
mathematician G. Green (1793-1841). ** 

We assumed that the domain D is regular. But, as in the area 
problem (see Sec. 3.2), it may be shown that this formula holds 
true for any domain that may be divided into regular domains. 


3.4 CONDITIONS FOR A LINE INTEGRAL TO BE 
INDEPENDENT OF THE PATH OF INTEGRATION 


Consider the line integral 


(N) 
| X (dx) +¥dy 
(M) 
taken around some plane curve L connecting the points M and N. 


We assume that the functions X (x, y) and Y (x, y) have conti- 
nuous partial derivatives in the domain D 


under consideration. Let us find out under Q N 
what conditions the line integral above is 

independent of the shape of the curve L ew 
and is dependent only on the position of M P 

the initial and terminal points M and N. Fig. 102 


Consider two arbitrary curves MPN and 
MQN lying in a given domain D and connecting the points M 
and N (Fig. 102). Let 


| Xdx+Ydy= | Xdx+Ydy (1) 
MPN MQN 
that is, 


| Xdx+Ydy— A Xdx+Ydy=0 
MPN MQN 


Then, on the basis of Properties 1 and 2 of line integrals (Sec. 3.1) 
we have 


{| Xdxs+Ydy+ | Xdx+Ydy=0 
NQM 


MPN 


* If in a line integral along a closed contour the direction of circulation 
is not indicated, it is assumed to be counterclockwise. If the direction of circu- 
lation is clockwise, this must be specified. 

** This formula is a special case of a more general formula discovered by 
the Russian mathematician M. V. Ostrogradsky. 
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which is a line integral around the closed contour L: 


| Xdx+Y dy =0 (2) 
L 


In this formula, the line integral is taken around the closed 
contour L, which is made up of the curves MPN and NQM. This 
contour L may obviously be considered arbitrary. 

Thus, from the condition that for any two points M and N the 
line integral is independent of the shape of the curve connecting 
them and is dependent only on the position of these points, it 
follows that the line integral along any closed contour is equal 
to zero. 

The converse conclusion is also true: if a line integral around 
any closed contour is equal to zero, then this line integral is inde- 
pendent of the shape of the curve connecting the two points, and 
depends only upon the position of the points. Indeed, equation (1) 
follows from equation (2). 

In Example 4 of Sec. 3.2, the line integral is independent of 
the path of integration; in Example 3 the line integral depends 
on the path of integration because there the integral around the 
closed contour is not equal to zero, but yields an area bounded by 
the contour in question; in Examples | and 2 the line integrals are 
likewise dependent on the path of integration. 

The natural question arises: what conditions must the functions 
X(x, y) and Y(x, y) satisfy in order that the line integral 


| Xdx+Y dy along any closed contour be equal to zero. The 


answer is given by the following theorem. 
Theorem. At all points of some domain D, let the functions 


X (x, y), Y (x, y), together with their partial derivatives oxe and 


ey be continuous. Then, for the line integrat along any closed 
contour L lying in this domain to be zero, that is, for 


Í X (x, yde+Y¥ (x, y)dy=0 2) 
L 
it is necessary and sufficient that the equation 
OX Y 
a OF (3) 


holds at all points of D. 
Proof. Consider an arbitrary closed contour L in D and write 
Green’s formula for it: 


(S (aay) d= SX dY dy 
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If condition (3) is fulfilled, then the double integral on the left 
is identically zero and, hence, 


| Xdx+Ydy=0 
L 
This proves the sufficiency of condition (3). 

Now we prove the necessity of this condition; that is, we prove 
that if (2) is fulfilled for any closed curve L in the domain D, 
then condition (3) is also fulfilled at each point of this domain. 
ee us assume, on the contrary, that equation (2) holds true, 
that is, 


| Xdx+Y dy =0 
L 


and that condition (3) does not hold, 


at least in one point. For example, suppose at some point P (x, Y.) 
we have the inequality 


Since there is a continuous function on the left, it will be positive 
and greater than some number 6 >0 at all points of some suffi- 
ciently small domain D’ containing the point P(x,, y,). Take the 


double integral of the difference ve over this domain. It will 


have a positive value. Indeed, : uy 
f (Z-Z )iray> ff Saedy—6 ff dray 8D" 50 


But by Green’s formula the left side of the last inequality is 
equal to a line integral along the boundary L’ of D’, which, by 
assumption, is zero. Hence, the last inequality contradicts condi- 
tion (2) and therefore the assumption that se is different 


from zero in at least one point is not correct. Whence it follows that 


at all points of the given domain D. 
The proof of the theorem is thus complete. 
In Sec. 1.9, it was proved that fulfilment of the condition 


OY (x, y) _ OX (x, y) 
öx y 
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is tantamount to the fact that the expression Xdx+Y dy is an 
exact differential of some function u(x, y), or 

Xdx+Y dy =du (x, y) 
and 


ð 0 
X =z VQ WF 


But in this case the vector 
- Ou Ou 
F=XitYj=z,itg,J 


is the gradient of the function u(x, y); the function u(x, y), the 
gradient of which is equal to the vector Xi+Y/j, is called the 
potential of this vector. 


(N) 
We shall prove that in this case the line integral I = f X dx+Y- dy 


(M) 
along any curve L connecting the points M and N is equal to the 
difference between the values of the function u at these points: 


(N) (N) 
f X dx +Y dy = f du (x, y) =u (N)—u (M) 
(M) (M) 
Proof. If Xdx+Ydy is the exact differential of the function 


ðu 


u(x, y), then x=, aa, and the line integral takes on the 
form 


(M) 
To evaluate this integral we write the parametric equations of 
the curve L connecting the points M and N: 
x= p(t), y=p(t) 
We shall assume that to the value of the parameter ¢=¢, 


corresponds the point M, and to t=T, the point N. Then the 
line integral reduces to the following definite integral: 


fe -f [seat + ay ar | 


The expression in the brackets is a function of ¢, and this func- 
tion is the total derivative of the function ulg (£), p(t)) with 
respect to ¢. Th reig 


I= (atuo, VOEO, O 


to 


—4[P (to), tp (4o)] =u (N)—u (M) 
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As we see, the line integral of an exact differential is independent 
of the shape of the curve along which the integration is performed. 
We have a similar assertion for a ljne integral over a space 
curve (see below, Sec. 3.7). 
Note. It is sometimes necessary to consider line integrals of 
some function X (x, y) along the arc length L: 


| X (x, y)ds= lim 3 X (xis y;) As; (4) 
L As;+0 i=l 


where ds is the differential arc length. Such integrals are evaluated 
in similar fashion to the line integrals considered above. Let the 
curve L be represented by the parametric equations 


x=9@(t), y=(t) 
where »(¢), p(t), p’ (¢), p (t) are continuous functions of t. 
Let æ and R be values of the parameter ¢ corresponding to the 
initial and terminal points of the arc L. 
Since 
ds=V p (+y (Hdt, 
we get a formula for evaluating integral (4): 


B 
f X(x, yds =È X lp, OIV OF FW O dt 
L @ 
We can consider the line integral along the arc of the space curve 
x=ọ (t), y=Ħ (t), 2=x (t): 


B pps estas ee 
[Xœ y, zds= (Xip PA, OIV P HHN A+ (Hadt 
L 


a 


By the use of line integrals along an arc we can determine, for 

example, the coordinates of the centre of gravity of lines. 
Reasoning as in Sec. 12.8, Vol. I, we obtain a formula for 

evaluating the coordinates of the centre of gravity of a space curve: 


f xas (yds f| zas 
EN E Sb pe ee 
Xc = { as » Yc (as » če { as (5) 
L L L 


Example. Find the coordinates of the centre of gravity of one turn of the 
helix 
x=acost, y=asint, z=bt (O<i < 2n) 


if its linear density is constant. 
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Solution. Applying formula (5), we find 


2n 
f acos t V œ sin? t +a cos? t+ b¥dt 


šc= 0 


on 
f V a sin? t Fa? cos? t +b? dt 
ò 
Qn 
f a cos t V a+b? dt 
0 a-0 
= on 57 =e 
f VEF dt 
0 
Similarly, yc=0, 
on 
f bt V Æ sinit +-a® cos? t F0? dt 
pete ERE EE EEE b-4n? = nb 
2n Vato? 2-21 


Thus, the coordinates of the centre of gravity of one turn of the helix are 


xc=0,. yc=0, zZc=71b 


3.5 SURFACE INTEGRALS 


Let a domain V be given in a rectangular xyz-coordinate system. 
Let a surface o bounded by a certain space curve A be given inV. 

With respect to the surface o we shall assume that at each 
point P of it the positive direction of the normal is determined 
by the unit vector n (P), the direction cosines of which are con- 
tinuous functions of the coordinates of the surface points. 

At each point of the surface let there be defined a vector 


F=X (x, y, z i+Y (x, y, 2)J+Z(x, y, ZR 


where X, Y, Z are continuous functions of the coordinates. 
Divide the surface in some way into subdomains Ao,. In each 
one take an arbitrary point P; and consider the sum 


X (F(P;) n (P,)) Ao; (1) 


where F (P;) is the value of the vector F at the point P; of the 
subdomain Ao;; n(P;) is the unit normal vector at this point and 
Fn is the scalar product of these vectors. 

The limit of the sum (1) extended over all subdomains Ao; as 
the diameters of all such subdomains approach zero is called the 
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surface integral and is denoted by the symbol 


f f Fndo , 
g 
Thus, by definition, * 
li . . a 
akaga 2 fan, as; SS a R @) 


Each term of the sum (1) 
F,n;Ao; =F,Ao; cos (2;, F;) (3) 


may be interpreted mechanically as follows: this product is equal 
to the volume of a cylinder with base Ao; and altitude F; cos (n;, F;). 
If the vector F is the rate of flow of a liquid through the sur- 
face o, then the product (3) is equal to the quantity of liquid 
flowing through the subdomain Ao; in unit time in the direction 
of the vector n; (Fig. 103). 


Fig. 103 


The expression \\ Fado yields the total quantity of liquid 


o 
flowing in unit time through the surface o in the positive direc- 
tion if by the vector F we assume the flow-rate vector of the 
liquid at the given point. Therefore, the surface integral (2) is 
called the flux of the vector field F through the surface o. 
From the definition of a surface integral it follows that if the 
surface o is divided into the parts o,, o,, ..., Op, then 


{È Fndo = | | Fndo + | È Fn do + ... +4 Fndo 


a O14 0; Ok 


* If the surface ø is such that at each point of it there exists a tangent 
plane that constantly varies as the point is translated over the surface, 
and if the vector function F is continuous on this surface, then this limit 
exists (we accept this existence theorem of a surface integral without proof). 
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Let us express the unit vector m in terms of its projections on 
the coordinate axes: 


n=cos(n, x)itcos(n, y)f+cos(n, z)R 


Substituting into the integral (2) the expressions of the vectors 
F and n in terms of their projections, we get 


\\ Fado =§{ [X cos(n, x)+Ycos(n, y)+Zcos(n, z)]do (2’) 


o o 


The product Ao cos (n, z) is the projection of the subdomain Ao on 
the xy-plane (Fig. 104); an analogous assertion holds true for the 
following products as well: 


Ao cos (n, x) =Ao,, Ao cos (n, y)=Ao,,, Ao cos (n, z) = AOsy (4) 
where Aodyz, AOxz, AOxy are the projections of the subdomain Ao 


on the appropriate coordinate planes. 
On this basis, integral (2’) can also be written in the form 


\\ Fado =| [X cos(n, x) +Ycos(n, y)+Zcos(n, z)]do 


= | | X dydz +Y dzdx + Z dx dy (2”) 


o 


3.6 EVALUATING SURFACE INTEGRALS 


Computing the integral over a curved surface reduces to eva- 
luating a double integral over a plane region. 
To illustrate, the following is a method of computing the integral 


‘a Zcos(n, z)do 


Let the surface o be such that any straight line parallel to the 
z:axis cuts it in one point. Then the equation of the surface may 
be written in the form 


z=] (x, y) 


Denoting by D the projection of the surface o on the xy-plane, 
we get (by the definition of a surface integral) 


(iZi, y, z) cos (n, z)do— lim 3 Z(x;, y;, z) cos (n;, 2) Ao; 


a am Ao; +0¢=1 
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Noting, further, the last of formulas (4), Sec. 3.5, we obtain 
ff Zcos(n, z)do= lim YYZ (xP ys Fn vD) (Aon) 
o diam AOzy > 0 j=] 
n 
=+ lim EZ, Yis Î (xis y;)) | A0 sy li 
diam Ao > 0; =] 
the last expression is the integral sum for a double integral of 
the function Z(x, y, f(x, y)) over the domain D. Therefore, 


{f Zcos(n, z)do=+ (f Ze, y, f(x, y))dxdy 
o D 

The plus sign in front of the double integral is taken if cos (n, 2) = 0, 

the minus sign, if cos(n, z) <0. 

If the surface o does not satisfy the condition indicated at the 
beginning of this section, then it is divided into parts that satisfy 
this condition, and the integral is computed over each part 
separately. 

The following integrals are computed in similar fashion: 


S) X cos (n, x)do, i Y cos (n, y)do 
o o 

The foregoing proof justifies the notation of a surface integral 
in the form of (2”), Sec. 3.5. 

Here, the right side of (2”) may be regarded as the sum of 
double integrals over the appropriate projections of the region o 
and the signs of these double integrals (or, otherwise stated, the 
signs of the products dydz, dxdz, dx dy) are taken in accord with 
the foregoing rule. 

Example 1. Let a closed surface o be such that any straight line parallel 


to the z-axis cuts it in no more than-two points. 
Consider the integral 


y z cos (n, z) do 


We shall call the outer normal the positive direction of the normal. 
In this case, the surface may be divided into two parts: lower and upper; 
their equations are, respectively, 
, z=fı(x, y) and z=f,(x, y) 
Denote by D the projection of o on the xy-plane (Fig. 105); then 


f zcos (n, zj do= È È fa (x y)dxdy—V f(x, y) dedy 
o D D 
The minus sign in the second integral is taken because in a surface integral 


the sign of dxdy on a surface z= f, (x, y) must be taken negative, since for it 
cos (n, z) is negative. 
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But the difference between the integrals on the right in the last formula 
yields a volume bounded by the surface o. This means that the volume of the 
solid bounded by the closed surface o is equal to the following integral over 
the surface 


V= f 2 cos (n, 2) do 
o 


Example 2. A positive electric charge e placed at the coordinate origin 
creates a vector field such that at each point of space the vector F is defined 
by the Coulomb law as 


e 
F=k-7r 


where r is the distance of the given point from the origin, r is the unit vector 
directed along the radius vector of the given point (Fig. 106), and k is a con- 
stant coefficient. Determine the vector-field flux through a sphere of radius R 
with centre at the origin of coordinates. 


Fig. 106 


o 
But the last integral is equal to the area of the surface o. Indeed, by the 
definition of an integral (noting that rn=1), we obtain 


rndo= lim r,it,Aop== lim Ao, =0 
15 nae a ae . 


Hence, the flux is front e 4nR* = 4nke. 


Ri 
3.7 STOKES’ FORMULA 


Let there be a surface ø such that any straight line parallel 
to the z-axis cuts it in one point. Denote by 4 the boundary of 
the surface ø. Take the positive direction of the normal æ so 
that it forms an acute angle with the positive z-axis (Fig. 107). 
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Let the equation of the surface be z= f(x, y). The direction 
cosines of the normal are expressed by the formulas (see Sec. 9.6, 
Vol. 1): 


(n, 8) = oo 
cos(n, x a Eye F 


cos(n, y) = ———— 2I (1) 


vo ET 


cos (n, 2) = Tay hy 
V! +(3 a +! ay ) 7 
We shall assume that the surface o lies entirely in some do 
main V. Let there be a function X (x, y, z) given in V that is 
continuous together with its first-order par- 
tial derivatives. Consider the line integral oe ye 
along the curve 2: è a n 


(X, y, 2)dx 
À 


On the curve A, z=f(x, y), where x, y 
are the coordinates of the points of the 
curve L, which is the projection of A on 
the xy-plane (Fig. 107). Thus, we can write 
the equation 


| Xi, y, z)dx== È X (x, y, F, de D) 3 ~~ 
À L Fig. 107 
The last integral is a line integral along 

L. Transform this integral by Green’s formula, putting 


X(x, y, f(x, y) = X (x, y), 0=F (x, y) 
Substituting into Green’s formula the expressions of X and Y, 
we obtain 


— [fA Gy E Mardy =( X(x, y, fde 3 
D L 


where the domain D is bounded by the curve L. On the basis of 
the derivative of the composite function X (x, y, f(x, y)), where 
y enters both directly and in terms of the function z= f(x, y), 
we find 

OX (x, y, F(x, y)) _ 2X z, ma Apa y, 2) Of (x, y) (4) 


oy oy 
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Substituting expression (4) into the left side of (3), we obtain 
ax e 2) OX (x, y, 2) OF (x, | a, 
=|) a "ay Jas dy 


dz 
=È X(x, y, F(x, W))dx 
L 


Taking into account (2), the last equation may be rewritten as 
ðX ox ð 
J Xs y, i E aaa k Lax dy (5) 
D 


The last two integrals can be transformed into surface integrals. 
Indeed, from formula (2”), Sec. 3.5, it follows that if we have 
some function A (x, y, z), the following equation is true: 


(fA, Y, z) cos (n, 2)do= [| Adxdy 


On the basis of this equation, the integrals on the right side 
of (5) are transformed as follows: 


| X dx dy = [fay eost z) do 


if X HE dxay= [SAE 2 costo, do 2 


Transform the last integral using formulas (1) of this section: 
dividing the second of these equations by the third termwise, 
we find 


cos (n, y) _ ôf 
cos (n, z) + oy 
or 
SE cos (n, z)=—cos(n, y) 
Hence, 
ðX ð 
Na öz se dey —— [f 3p cos (n, y) do (7) 


Substituting expressions (6) and (7) into equation (5), we get 
Ox ox 
X (x, y, 2)dx=— \\ ——cos(n, z)do + \\ ——cos(n, y)do (8) 
i 7 oy i dz 


The direction of circulation of the contour 4 must agree with 
the chosen direction of the positive normal n. Namely, if an 
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observer looks from the end of the normal, he sees the circulation 
along the curve A as being counterclockwise. 
Formula (8) holds true for any surface if this surface can be 
divided into parts whose equations have the form z=f(x, y). 
Similarly, we can write the formulas 


yru Y, z) dy = sf za +X cos(n, 2) |do (8’) 
fzo Y, TEIE % cos (n, y) +52 cos(n, x) |do (8”) 


Adding the left and right sides of (8), (8’), and (8”), we get the 
formula 


| Xde-Vdy-+ 2de= {i (%-— Sr) cos (n, x) 


+($-) cos (n, n+ ES) cos (a, 2)|do (9) 


This formula is called Stokes’ formula after the English physicist 
and mathematician G. H. Stokes (1819-1903). It establishes a re- 
lationship between the integral over the surface o and the line 
integral along the boundary A of this surface, the curve A being 
traversed according to the same rule as that given earlier. 

The vector B, defined by the projections 
az ay ax Z p _ a ox 

x ðy az’ v~ @z ox’ “ox. dy’ 

is called the curl of the vector function F= Xi+Yj+Zk and is 
denoted by the symbol curl F. 

Thus, in vector notation, formula (9) will have the form 


| Fads = | | m curl Fdo (9°) 


and Stokes’ theorem is formulated thus: 

The circulation of a vector around the contour of some surface 
is equal to the flux of the curl through this surface. 

Note. If the surface ø is a piece of plane parallel to the 
xy-plane, then Az =0, and we get Green’s formula as a special 
case of Stokes’ formula. 

From formula (9) it follows that if 


OY ðX ðZ oY OX Of 


Ox ðy oy oz. Oz Ox =O (10) 
then the line integral along any closed space curve A is zero: 


| Xdx+Y dy+Zdz=0 (11) 
a 
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Whence it follows that the line integral is independent of the 
shape of the curve of integration. 
As in the case of a plane curve, it may be shown that the 
indicated conditions are not only sufficient but also necessary. 
In the fulfilment of these conditions, the expression under the 
integral sign is an exact differential of some function u(x, y, 2): 


Xdx+Ydy+Zdz=du(x, y, 2) 
and, consequently, 


(N) (N) 
f X dx +Y dy + Z dz = f du =u (N)—u (M) 
(M) (M) 


This is proved exactly like the corresponding formula for a func- 
tion of two variables (see Sec. 3.4). 


Example 1. Write the basic equations of the dynamics of a material point: 
dux du, duz 
m=, ma=Y, map=e 
Here, m is the mass of the point, X, Y, Z are the projections of a force, 
acting on the point, onto the coordinate axes; v E v. =% U ae are 
i edt’? “Y dt’ © dt 


the projections of velocity v onto the axes. 
Multiply the left and right sides of these equations by the expressions 


vdt =dx, vįdt=dy, vdt =dz 
Adding the given equations term by term, we obtain 
m (0,dv, +vydvy+vdvz) = X dx +Y dy +Z dz 
m- dotti) =X dr+Y dy -+Z dz 
Since vł-++ 0} +03 =v?, we can write 
d (ym!) =X de+¥ dy +2 de 


Take the integral along the trajectory connecting the points Mı and Mg: 


i i (Ma) 
Si mvs ——> mo? = f Xdx+Y dy +Zdz 
(Ma) 


where v, and v, are the velocities at the points M, and Mg. 

This last equation expresses the work-kinetic energy theorem: the increase in 
kinetic energy when passing from one point to another is equal to the work of 
the force acting on the mass m. 

Example 2. Determine the work of the force of Newtonian attraction to a 
fixed centre of mass m in the translation of unit mass from M, (a, bı, c1) to 
Ma (aa, bs» C3). 
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Solution. Let the origin be in the fixed centre of attraction. Denote by r 
the radius vector of the point M (Fig. 108) corresponding to an arbitrary po- 
sition of unit mass, and by r° the unit vector directed along the vector r. 


Then F=— Ër, where k is the gravitation cogstant. The projections of the 
force F on the coordinate axes will be 


Z Y=—km4 t, Zz 
T rr 


1 z 
— km — — 
ror 


X=— km 


Then the work of the force F over the path 
MM, is 


OO” eed payed 
xdx+ydytzdz 
(My) 
Ms) (M3) 
AO 
r 
1) (M4) 
(since r?=x% + y? + 2%, it follows that Fig. 108 


rdr=xdx-+ydy+zdz). If we denote by r, 
and ra the lengths of the radius vectors of the points M, and Mz, then 


Thus, here again the line integral does not depend on the shape of the 
curve of integration, but only on the position of the initial and terminal 


points. The function u=*" is called the potential of the gravitational field 
generated by the mass m. In the given case, l 


Ou Ou Ou 
x=. Yas. Z=% A=u(M)—u (M) 


that is, the work done in moving unit mass is equal to the difference between 
the values of the potential at the terminal and initial points. 


3.8 OSTROGRADSKY'S FORMULA 


Let there be given, in space, a regular three-dimensional domain 
V bounded by a closed surface o and projected on an xy-plane 
into a regular two-dimensional domain D. We shall assume that 
the surface o may be divided into three parts o,, o, and o, 
such that the equations of the first two have the form 


z=f,(x, y) and z=f,(x, y) 


where f,(x, y) and f,(x, y) are functions continuous in D and the 
third part o, is a cylindrical surface with generator parallel to 
the z-axis. 


16-—2082 
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Consider the integral 


= OZ (x, y, 2) 
I= NS SOP dedy de 
First perform the integration with respect to z: 

fa (x, y) 

1={9( f S dz )dedy 
fa (x, y) 

=f Z, y, he mdxdy—\V Zi, v, hœ dedy (1) 
D 


On the normal to the surface, choose a definite direction, name- 
ly that which coincides with the direction of the outer normal 
to the surface o. Then cos(n, z) will be positive on the surface 
O, and negative on the surface o,; on the surface o, it will be 
zero. 

The double integrals on the right of (1) are equal to the cor- 
responding surface integrals: 


Wz, Y, fa (x, y))dxdy= Í Í Z (x, Y, z)cos(n, z)do = (2’) 


Os 


fize, y, f(x, y)) dx dy = Í | Z (x, y, z)(— cos (n, z))do 


0: 


In the last integral we wrote [eoat z)] because the elements 
of surface o, and o, and the element of area As. of the domain D 
are connected by the relation As = Ao [— cos (n, z)], since the 
angle (n, z) is obtuse. 

Thus, 


If Ze, y, fils, Mydxdy=—S) Zi, y, f(x, y))cos(n, z) do (2") 
Substituting (2’) and (2”) into “(), we obtain 


eef SES, oe dx dy dz 
V 


=( Í Zx, Y, z) cos (n, z)do+\§ Z (x, y, z) cos (n, 2) do 


Og 0: 
For the sake of convenience in subsequent formulas, we shall rewrite 
the last equation as follows (adding \\Zq, yY, z) cos (n, 2)do=0, 


G7) 
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since the equation cos(n, z)=0 is fulfilled on the surface a): 


i f (ZOL? dxdydz 


= {J Zcos(n, z) do + {§Zcos(n, 2)do+§{Zcos(n, z) do 


Os 0: 


But the sum of integrals on the right of this equation is an in- 
tegral over the entire closed surface o; therefore, 


(ff SE dxrayaz= fÈ Zi, yY, z) cos (n, z) do 
V o 
Analogously, we can obtain the relations 
Sf Ý dxdydz= È (Y (x, y, 2)cos(n, y)do 


o 


sS = dx dy dz = ff X (x, y, z)cos(n, x)do, 


Adding together the last three equations term by term, we get 
Ostrogradsky’s formula:* 


(EAZ teaver 
= {J (X cos(n, x)+Ycos(n, y)+Zcos(n, z))do (2) 


The expression e+ Ft is called the divergence of the vec- 
tor (or the divergence of the vector function): 
F=Xi+YJj+Zk 
and is denoted by the symbol div F: 


y ðX oY 6Z 
dW Poe tag) os 


We note that this formula holds true for any domain which 
may be divided into subdomains that satisfy the conditions indi- 
cated at the beginning of this section. ~ 

Let us examine a hydromechanical interpretation of this formula. 

Let the vector F=Xi+Yj+2Zk be the velocity vector of a 
liquid flowing through the domain V. Then the surface integral in 


* This formula (sometimes called the Ostrogradsky-Gauss formula) was disco- 
vered by the noted Russian mathematician M. V. Ostrogradsky (1801-1861) and 
published in 1828 in an article entitled “A Note on the Theory of Heat”. 


16 * 
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formula (2) is an integral of the projection of the vector F on the 
outer normal n; it yields the quantity of liquid flowing out of 
domain V through the surface o in unit time (or flowing into V if the 
integral is negative). This quantity is expressed in terms of the 
triple integral of div F. 

If div F=0, then the double integral over any closed surface 
is equal to zero, that is, the quantity of liquid flowing out of 
(or into) something through any closed surface o will be zero (no 
sources). More precisely, the quantity of liquid flowing into a domain 
is equal to the quantity of liquid flowing out of the domain. 

In vector notation, Ostrogradsky’s formula has the form 


JS div Fv = (f Fnds (1’) 


and reads: the integral of the divergence of a vector field F exten- 
ded over some volume is equal to the vector flux through the surface 
bounding the given volume. 


3.9 THE HAMILTONIAN OPERATOR 
AND SOME APPLICATIONS 


Suppose we have a function u=u (x, y, z). At each point of the 
domain in which the function u(x, y, z) is defined and differen- 
tiable, the following gradient is determined: 


gradu=1 +J tke (1) 


The gradient of the function u(x, y, z) is sometimes denoted as 
follows: 


ðu Ou Ou 
Vu=ig tla tk a (2) 
The symbol ¥ is read “del”. 
(1) It is convenient to write equation (2) symbolicaliy as 
a ə a \ f 
vu=(istig ths )u (2) 
and to consider the symbol 
ð Ps] ð 
V=la tla tka (3) 
as a “symbolic vector”. This symbolic vector is called the Hamil- 
tonian operator or del operator (Y-operator). From formulas (2) 


and (2’) it follows that “multiplication” of the symbolic vector y 
by the scalar function u gives the gradient of this function: 


Vu=gradu (4) 
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(2) We can form the scalar product of the symbolic vector y by 
the vector F=iX+jfY +kZ: 


VF=(i5+s5 +h 3) (iX +JY +kZ) 
f) ð ð ðX , OY ðZ}, 
(see Sec. 3.8). Thus, 
yF=div F (5) 


(3) Form the vector product of the symbolic vector y by the vector 
F=iX +JY +kZ: 


vxF=(1 pt th )X(IX+IY +Z) 


ijk| |9 9| J2 əj Joe 
eee el aay lee alee 
XY Z 
=1( 2-2) _7( Z-Z) (Z) 
P EM ra mc 


(see Sec. 3.7). Thus 
vVxF=curl F (6) 

From the foregoing it follows that vector operations may be 
greatly condensed by the use of the symbolic vector y. Let us 
consider several more formulas. 

(4) The vector field F(x, y, z)=iX+JY+kZ is called a poten- 
tial vector field if the vector F is the gradient of some scalar 
function u(x, y, 2): 

F= gradu 
i ð 
ðu ðu u 
F=iġtJ ay t ar 
In this case the projections of the vector F will be 
Ou ðu ðu 
X = ox ’ ey ’ Z = Sasi 
From these equations it follows (see Sec. 8.12, Vol. I) that 
OX ðY oY OZ OX OZ 


ðy ox’ Oz Oy’ ðz Ox 


oY ðZ ðX ðZ 
Oy Oe ua ag no ar ae 


246 Ch. 3 Line Integrals and Surface Integrals 


Hence, for the vector F under consideration, 


curl F=0 
Thus, we get 
curl (grad u) = 0 (7) 
Applying the del operator V, we can write (7) as follows [on the 
basis of (4) and (6)]: 
(VxVu)=0 (7’) 


Taking advantage of the property that for multiplication of a 
vector product by a scalar it is sufficient to multiply the scalar 
by one of the factors, we write 

(VX V)u=0 (7’) 
Here, the del operator again has the properties of an ordinary 
vector; the vector product of a vector into itself is zero. 

The vector field F(x, y, z), for which curl F=0, is called irro- 
tational. From (7) it follows that every potential field is irrota- 
tional. 

The converse also holds: if some vector field F is irrotational, 
then it is potential. The truth of this statement follows from rea- 
soning given at the end of Sec. 3.7. 

(5) A vector field F (x, y, z) for which 

div F=0 


that is, a vector field in which there are no sources (see Sec. 3.8) 
is called solenoidal. We shall prove that 


div (curl F) =0 (8) 


or that the rotational field is source-free. 
Indeed, if F=ix+JjY-+hkZ, then 


/ OZ oY ./ OX OZ OY Ox 
curl =i (35 — 35) +4( ae) +4 a) 
and therefore 
2 0 / ðZ oY ð / ðX ðZ ð / ƏY ðX 
div (curl I= 3 (3p ae) tay (ae — ae ) tae (ae a 
Using the del operator, we can write equation (8) as 
V(VxF)=0 (8°) 


The left side of this equation may be regarded as a vector-scalar 
(mixed) product of three vectors: V, V, F, of which two are the 
same. This product is obviously equal to zero. 

(6) Let there be a scalar field u=u (x, y, z). Determine the 
gradient field: 


ðu ðu Ou 
grad u=ia tla tka 
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Then find 
; ð (ðu ð (ðu ð / ðu 
div (grad 4“) = 3 (Se) tay (Sy) +e (Fe) 
or 
: ð? 0? 0? 
div (grad u) =a ta t oa (9) 


The right member of this expression is denoted by 


Ou ðu Ou 


Au=satoat ot (10) 
or, symbolically, 
The symbol 

b=Stete 


is termed the Laplacian operator. 
Hence, (9) may be written as 


div (grad u) = Au (11) 
Using the del operator Y we can write (11) as 
(VVu)=Au, i.e., A=? (11’) 
We note that the equation 
Sat gat or =0 (12) 
or 
Au=0 (12’) 


is called the Laplace equation. The function that satisfies the Lap- 
lace equation is called a harmonic function. 


Exercises on Chapter 3 


Compute the following line integrals: 
1. f y? dx + 24y dy over the circle x :=a cos t, y =a sin t. Ans. 0. 


2. | ydr—xdy over an arc of the ellipse x=a cost, y=b sint. 
Ans. —2nab. 
x __Y F ; i 
app” AF dy ) over a circle with centre at the origin. Ans. 0. 
4 y dx +x dy 
f x+y? 
x=2. Ans. In 2. 


5. \ yzdx-+xzdy+xydz over an arc of the helix x=a cos t, y=asint, 
z=kt as t varies from 0 to 27. Ans. 0. 


) over a segment of the straight line y =x from x=1 to 
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6. | xdy—y dx over an arch of the astroid x=a cos?t, y=a sin? t. 


Ans + na? (the double area of the astroid). 
7. f xdy—yds over the loop of the folium of Descartes x= 7] =e 


2 ; 
gu Ans. 3a? (the double area of the region bounded by the indicated 


8. | xdy—yde over the curve x =a (t— sin £t), y =a (1 — cos t) (0 < t & 27). 


Ans. — 6na? (the double area of the region bounded by one arch of a cycloid 
and the x-axis). 
Prove that: 
9. grad (c p)=c grad ọ, where c is a constant. 
10. grad (cyp-—+cotp)=c,; grad p+c grad p, where c} and cg are constants. 
It. grad (pp) = grad p+ grad ọ. 


12. Find grad r, grad r?, grad + , grad f(r), where r= V x2} y+ z. 
r r i r 
Ans. 7 2r, — FT: f (Oia 


13. Prove that div (A+ B)= div A+ div B. 

14. Compute div r, where r=xi-+yj-+ zk. Ans. 3. 

15. Compute div(Ag), where A is a vector function and @ is a scalar function. 
Ans. ọ div A+ (grad @ A). 


16. Compute div (r-c) where c is a constant vector. Ans. 


17. Compute div B(rA). Ans. AB. 

Prove that: 

18. rot (cyA,-+c,A,) =c, rot A, +c rot Aa, where cı and c, are constants. 
19. rot (Ac)=grad A X c, where ¢ is a constant vector. 

20. rot rot A= grad div A—A A. 

21. Axrot p=rot (pA). 


(e:r) 
r 


Surface Integrals 

22. Prove that f È cos (n, z2)do=0 if ø is a closed surface and a îs a 
normal to it. 

23. Find the moment of inertia of the surface of a segment of a sphere with 
equation x*-+ y?+z?=R* cut off by the plane z=H relative to the z-axis. 
Ans. aR (2R?—3R2H + H’). 

24. Find the moment of inertia of the surface of the paraboloid of revolution 


x3 + y? = 2cz cut off by the plane z =c relative to the z-axis. Ans. 4nc* shee . 
25. Compute the coordinates of the centre of gravity of a part of the surface 


2 
of the cone at= z? cut off by the plane z= H. Ans. 0, 0, zh 

26. Compute the coordinates of the centre of gravity of a segment of the 
surface of the sphere x?-+-y?+-z3=R? cut off by the plane z=H. 
Ans. (0. 0, 235) Sf 
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27. Find {i [x cos (x) + y cos (my) + z cos (nz)] do, where o is a closed 
(ed 
sutface. Ans. 3V, where V is the volume of the solid bounded by the surface ø. 
28. Find {f zdxdy, where S is the external side of the sphere x? -+ y? + 
S 
+2 =R. Ans. Fnk. 
29. Find {\ 2 dy dz -+ y? dz dx 4-22 dx dy, where S is the external side of 
S 
the surface of the sphere x?+-y?-++z?=R*. Ans. 2nR'. 
30. Find {i V x?-+ y2ds, where S is the lateral surface of the cone 
S 


2 2 2 2 2 
544-50, oaza. Ans, TEVE, 
31. Using the Stokes formula, transform the integral È ydetedy+xdz. 


Ans. — {J (cos a + cos B + cos y) ds. 
S 


Find the line integrals, applying the Stokes formula and directly: 
2 f (y +z) dx+ (z+ x) dy + (x+ y) dz, where L is the circle x? + y+ 2 =a?, 


L 
x+y+z=0. Ans. 0. 33. f x?yS dx dy + z2dz, where L is the circle x? -+ y? = R9, 
L 
6 
z=0. Ans. =. 


Applying the Ostrogradsky formula, transform the surface integrals into 
volume integrals: 


34. e tr a fraid Ans. Vha 


35. | Sete evar aede j aE do Ans. ap etprS ikiya 


36. [eetarea Ans. 0. 37. FY Savarese dx dy. 


on SES (SARE) arayan 


Using the Ostrogradsky formula compute the following integrals: 


38. \f (x cos a + y cos R+ z cos y) ds, where S is the surface of the ellipsoid 
S 


5+5 +5 Zoi: Ans. 4nabc. 39. ean an where S 


is the surface of the sphere x34 92-+-z?=R*. Ans. Ba aR’. 40. \\# dy dz + 
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2 2 
+ y? dz dx+4-z? dx dy, where S is the surface of the cone 5+5- -5= =0 
(O<z<b). Ans. a . 4l. fÈ x dy de-+y dx dz+z dx dy, where S is the 


S 
surface of the cylinder x?+y2=a?, —H<z<H. Ans. 3na?H. 42. Prove the 
identity si (S= +r) deay= | 5a where C is a contour bounding the 


domain D, and a is the directional derivative of the outer normal. 


Solution. 
(f (Se 5p) ddy= f —Y dex dy=f [Y cos (s, 2) +X sin €, x) ds 
D č A 


where (s, x) is the angle between the tangent line to the contour C and the 
x-axis. If we denote by (n, x) the angle between the normal and the x-axis, 
then sin (s, x)= cos (n, x), cos (s, x)= — sin (n, x). Hence, 


f (E) a= [X cos (n, x)+Y sin (n, x)] ds 


: ðu, ,, Ou 
Setting X=x5 yoy? we get 


(SSH) oof ow agno s]a 
D c 


õu Ou 
MS [a rt Bye] axa an 
2 


.  @u ; ; 
The expression Tit is called the Laplacian operator. 


or 


43. Prove the identity (called Green’s formula) 


i) (vAu —uAv) dx dy dz = i CEF- 7) do 


where u and v are continuous functions wiih continuous derivatives up to the 
second order in the domain D. 
The symbols Au and Av denote 


_@u , u , Pu ðu 


au =e tay oy? taz oz?’ Apa Th sS Ta at or 02? 


Solution. In the formula 
s5 (A++ S) dx dy a=] [X cos (n, x) +Y cos (n, y)+Z cos (n, z)] do 


z put 
o La 
X =Vüx— uvx 
r L 
Y = vuy — Udy 
o N 
Z= vuz — Uvz 
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Then 

aX ƏY ðZ es e De 3 tg NG 

oe tag Var? (Wex + uyy + uzz)—u (vzx+ vyu +022) =vAu —udv 
X cos (n, x) +Y cos (n, y)+Z cos (n, 2) 


= v[uz cos (n, x)+uy cos (n, y)+uzcos (n, 2)] 
ðu du 


— — u = 


—ul[vx cos (n, x)+vy cos (n, y)+vzcos (n, z)] = 05855 


s5 (vAu — u^v) dx dy esj) (o-u )d 


44. Prove the identity 
ðu 
Sis Au de dy dz= È È Ë do 
V (o 


ðu , Ou , Ou 

where Au= 5g t Jy” +3 

Solution. In Green’s formula, which was derived in the preceding problem, 
put v=I. Then Av=0, and we get the desired identity. 

45. If u(x, y, z) is a harmonic function in some domain, that is, a function 
which at every point of the domain satisfies the Laplace equation i 

Ou , Au, u 

Ox? T oy? + oz? =0 


ðu 
o 
where ø is a closed surface. 


Solution. This follows directly from the formula of Problem -44. 

46. Let u(x, y, 2) be a harmonic function in some domain V and let there 
be, in V, a sphere, ø with centre at the point M (x1, Yı, 21) and with radius R. 
Prove that 


Hence, 


then 


1 
u (x1, Yi» a=z J udo 
o 


Solution. Consider the domain Q bounded by two spheres o, o of radii R 


and p (p < R) with centres at the point M (xı, Yı, 21). Apply Green’s formula 
(found in Problem 43) to this domain taking for u the above-indicated function, 
and for the function v, 


1 
~ Veen +y—n tea 
ðu 


By direct differentiation and substitution we are convinced that JE 
o?u 


l 
v=— 
r 


+% =0. Consequently, 


l 
ð— 
1 ðu r ) 
f (aa E pom 


o+G 
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(JG) (fea) ane 


On the surfaces o and o the quantity a is constant z and +) and so can 


- p 
be taken outside the integral sign. By virtue of the result obtained in Problem 45, 


we have 4 
p Mfdene t [famo 
Hence, ; i 
P 
z o 
but i i 
Aaoi 
Therefore, á 
+ gee lene 0 
or 


nffem [ee w 


Apply the mean-value me to the integral on the left: 


affe uao" È N Se F 


where u (Ẹ, n, È) is a point on the surface of a sphere of radius p with centre 
at the point M (x1, Y1, 2). 

We make p approach zero; then u (Ẹ, 4, k) U(X, Yis 2): 
=t 


Hence, as p +0, we get 
1 
p S u do => u (Xis Yi, zı) 4n 
o 
Further, since the right side of (1) is independent of p, it follows that as 
p > 0 we finally get 


1 
ge f| d= 4nu (x1, Yr, 21) 


o 
l 
g u (%1, Yr *)= TRF (fuas 
a 


CHAPTER 4 


SERIES 


4.1 SERIES. SUM OF A SERIES 


Definition 1. Suppose we have an infinite sequence of numbers * 
Uys Uys yy 2254) gy nce 
The expression 


u,tu,tu,t+...+u,+... (1) 


is called a numerical series. Here, the numbers w,, Ug, ...,U,, .-- 
are called the terms of the series. 

Definition 2. The sum of a finite number of terms (the first n 
terms) of a series is called the nth partial sum of the series: 


Sp=U,t+u,t+...+U, 
Consider the partial sums 
S =U, 
Sa =U, + Ug 
S, =U, +U + U 
Sn =U, +UgtUg+... HUn 


If there exists a finite limit 


s= lim s, 
n= œo 
it is called the sum of the series (1) and we say that the series 


converges. 
If lims, does not exist (for example, Ss,— œ as n— œ), then 


we say that the series (1) diverges and has no sum. 
Example. Consider the series 
a+aqg+ag?+...--agr-t-+... (2) 


This is a geometric progression with first term a and ratio q (a Æ 0). 


* A sequence is considered specified if we know the law by which it is 
possible to determine any term uw, for a given n. 
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The sum of the first n terms of the geometric progression is (when q # 1) 


__ a—aq" 
nan 1—q 
or 
Geese a 
no i—q l—q 


(1) If |g| < l, then q” +0 as n+ and, consequently, 


n>» n» œ\ 1—4 1—q 1—q 
Hence, in the case of |q | < 1, the series (2) converges and its sum is 
s= 
a er 


a—aq" 
l—q 
that is, lim s, does not exist. Thus, when |q] > 1, the series (2) diverges. 


(3) if ges 1, then the series (2) has the form 
ata+a+... 


(2) If |g| > 1, then |q"|— œ as n— œ and then 


>+>+toasn>o,. 


In this case 
Sn = na, lim s, = œ 
now 


and the series diverges. 
(4) If g=—1, then the series (2) has the form 


a—a+a—a+... 


In this case 


Be 0 when n is even 
n~ \ a when n is odd 


Thus, s, has no limit and the series diverges. 
Thus, a geometric progression (with first term different from zero) converges 
only when the ratio of the progression is less than unity in absolute value. 


Theorem 1. /f a series obtained from a given series (1) by sup- 
pression of some of its terms converges, then the given series itself 
converges. Conversely, if a given series converges, then a series 
obtained from the given series by suppression of several terms also 
converges. 

In other words, the convergence of a series is not affected by the 
suppression of a finite number of its terms. 

Proof. Let s, be the sum of the first n terms of the series (1), 
Ck, the sum of k suppressed terms (we note that for a sufficiently 
large n, all suppressed terms are contained in the sum s,), and 
O„-p, the sum of the terms of the series that enter into the sum s, 
but do not enter into c,. Then we have 


Sn = Cp T On-k 


where c, is a constant that is independent of n. 
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From this relation it follows that if lim o,_, exists, then lim s, 


nwo awn 
exists as well; if lim s, exists, then lim o,_, also exists; which 
n= R n=% 
proves the theorem. : 
We conclude this section with two simple properties of series. 
Theorem 2. /f a series 


atat... (3) 
converges and its sum is s, then the series 
ca,+Cca,+... (4) 


where c is some fixed number, also converges, and its sum is cs. 
Proof. Denote the nth partial sum of the series (3) by s,, and 
that of the series (4), by o,. Then 


0,=Ca,+...+ca,=c(a,+...+a,)=cs, 


It is now clear that the limit of the nth partial sum of the 
series (4) exists, since 


lim o, =lim (cs,)=c lim s,=cs 
nwo nwo nwo 


Thus, the series (4) converges and its sum is equal to cs. 
Theorem 3. /f the series 


a,ta,+... (5) 

and 
bi-+ba+... e (6) 
converge and their sums, respectively, are s and s, then the series 
(ai +6,)+(a,+6,)+... (7) 

and 
(ai —b,) + (a,—6,) +... (8) 


also converge and their sums are s+ s and s—s, respectively. 
Proof. We prove the convergence of the series (7). Denoting its 
nth partial sum by o, and the nth partial sums of the series (5) 


and (6) by s, and s,, respectively, we get 
On = (A, +b) +... + (an +n) 
= (44... Ha) +t... +b) =S Sp 
Passing to the limit in this equation as n— oo, we get 
Jim On =lim a HSn) = lim S, e Sn =5 +5 


Thus, the series (7) converges and its sum is S+s. 
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Similarly we can prove that the series (8) also converges and 


its sum is equal to s—s. 

We say that the series (7) and (8) were obtained by means of 
termwise addition or, respectively, termwise subtraction of the 
series (5) and (6). 


4.2 NECESSARY CONDITION FOR CONVERGENCE 
OF A SERIES 


One of the basic questions, when investigating series, is that of 
whether the given series converges or diverges. We shall establish 
sufficient conditions for one to decide this question. We shall also 
examine the necessary condition for convergence of a series; in 
other words, we shall establish a condition for which the series 
will diverge if it is not fulfilled. 

Theorem. /f a series converges, its nth term approaches zero as n 
becomes infinite. 

Proof. Let the series 


U, Fu, +U +... turt... 
converge; that is, let us have 
lim s, =s 


non 
where s is the sum of the series (a finite fixed number). But then 
we also have the equation 

lim s,-,=S 


n>a 


since (n—1) also tends to infinity as n—+oo. Subtracting the 
second equation from the first termwise, we obtain 


lim s,—lim s,_,=0 


n> o n>a 
or 
lim (S,—Sp-1) =0 
n>a 
But 
Sn—Sn-1 = Un 
Hence, 
lim u„,=0 
n> V 


which is what was to be proved. 
Corollary. /f the nth term of a series does not tend to zero as 
n— oo, then the series diverges. 
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Example. The series 
l 2,3 n 
gor ge rg 
diverges, since g 


n 


: A l 
lim un = lim (z5r) =7*. 


non n>+o\ 


We stress the fact that this condition is only a necessary con- 
dition, but not a sufficient condition; in other words, from the 
fact that the nth term approaches zero, it does not follow that the 
series converges, for the series may diverge. 

For example, the so-called harmonic series 


l L1 1 
l4g+gtg te. tot... 
diverges, although 
lim u,=lim 4 =0 


RR noo 
To prove this, write the harmonic series in more detail: 
| 1 1 1 1 1 1 
LP ohgra tet ete te 
—— poua 
Pe Te a Te a T oa l 
+otptrtptisthytistietiyt -: (1) 
: : 


pace ae EN 


We also write the auxiliary series 


l l 1 l 1 1 1 
ltotagtatetetets 
16 terms 
—aeEee eee" 


ee ee ee ey eee l 
+ yetietietretietigtigtigtaat---+gt--. (2) 


The series (2) is constructed as follows: its first term is equal 
to unity, its second is 1/,, its third and fourth are '/,, the fifth 
to the eighth terms are equal to 1/,, the terms 9 to 16 are equal 
to 1/,,, the terms 17 to 32 are equal to 1/,,, etc. 

Denote by s® the sum of the first n terms of the harmonic series (1) 
and by s the sum of the first n terms of the series (2). 

Since each term of the series (1) is greater than the corres- 
ponding term of the series (2) or equal to it, then for n >2 


sP > sP (3) 


We compute the partial sums of the series (2) for values of n 
equal to 2!, 22, 23, 24, 25: 


1 
s=1+4=1+15 


17 —2082 
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1 1l 


s=l+y+(atq)t(etatete)al+3-5 
se=l+at(gta)t(gt- te)t(et--- te) 
D yil 8 terms 
a a +a) + (at SFT) 
t+(at ee Bi 
16 terms 


in the same way we find that s¢=14+6-4, sy = 147-5 and, 
generally, s,* = l+. 
Thus, for sufficiently large k, the partial sums of the series (2) 
can be made greater than any positive number; that is, 
lim si) = oo 


but then from the relation (3) it also follows that 
lim s{P = oo 


n>n 


which means that the harmonic series (1) diverges. 


4.3 COMPARING SERIES WITH POSITIVE TERMS 


Suppose we have two series with positive terms: 
U,+u,+ugt...tu,+... (1) 
VU, Hu HU t... HUn t... (2) 
For them the following assertions hold true. 
Theorem 1. /f the terms of the series (1) do not exceed the cor- 
responding terms of the series (2); that is, 
Un<v, (n=1, 2, ...) (3) 


and the series (2) converges, then the series (1) also converges. 
Proof. Denote by s, and o,, respectively, the partial sums of 
the first and second series: 
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From the condition (3) it follows that 


Sn SOn (4) 
Since the series (2) converges, its partial sum has a limit o: 
lim 6, =6 
n>n 


From the fact that the terms of the series (1) and (2) are posi- 
tive, it follows that o, < o, and then, by virtue of (4), 
S, <0 


We have thus proved that the partial sums s, are bounded. We 
note that as n increases, the partial sum s, increases, and from 
the fact that the sequence of partial sums is-bounded and increases, 
it follows that it has a limit * 


lim s,=s 


n>o 


and it is obvious that 
s<o 


Using Theorem 1, we can judge of the convergence of certain 
series. 


Example 1. The series 
1 1 1 1 
Itoptatgit- tate 


converges because its terms are smaller than the corresponding terms of the 
series 


1,1,1 1 
l+atatat e tat 


But the latter series converges because its terms, beginning with the second, 


form a geometric progression with common ratio zz: The sum of this series 
is equal to Iz. Hence, by virtue of Theorem 1, the given series also conver- 
ges, and its sum does not exceed iz ; 


Theorem 2. If the terms of the series (1) are not smaller than 
the corresponding terms of the series (2); that is, 


Un Up (5) 
and the series (2) diverges, then the series (1) also diverges. 


* To convince ourselves that the variable s, has a limit, let us recall a con- 
dition for the existence of a limit of a sequence (see Theorem 7, Sec. 2.5, Vol. I): 
“if a variable is bounded and increases, it has a limit.” Here, the sequence of 
sums s, is bounded and increases. Hence it has a limit, i.e., the series con- 
verges. 


17 # 
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Proof. From condition (5) it follows that 
Sn 2 On (6) 


Since the terms of the series (2) are positive, its partial sumo, 
increases with increasing n, and since it diverges, it follows that 


lim 6, = 00 
n=% 

But then, by virtue of (6), 
lin s, = 00 
n> g 


e., the series (1) diverges. 


Example 2. The series 


tee eee 


V3'V3 EN 


diverges because its terms (from the second on) are greater than the correspon- 
ding terms of the harmonic series 


11 1 
Itg+gte tote 


which, as we know, diverges. 

Note. Both the conditions that we have proved (Theorems 1 
and 2) hold only for series with positive terms. They also hold 
true when some of the terms of the first or second series are zero. 
But these conditions do not hold if some of the terms of the series 
are negative numbers. 


4.4 D’ALEMBERT’S TEST 


Theorem (d’Alembert’s test). /f in a series with positive terms 
u,tu,tus+...tu,+... (1) 


the ratio of the (n+1)th term to the nth term, as n— œ, has a 
(finite) limit l, that is, 


lim “241 = 1 (2) 
n>a n 
then: 
(1) the series converges for l< 1 
(2) the series diverges for [> 1. 
(For [=1, the theorem does not yield the convergence or diver- 
gence of the series.) 
Proof. (1) Let ¿< 1. Consider a number q(l <q < 1) (Fig. 109). 
From the definition of a limit and relation (2) it follows that 
for all values of n after a certain integer N, that is, for n>N, 
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we will have the inequality 
S <q (2) 


Un 
Indeed, since the quantity E tends to the limit l, the dif- 


ference between the quantity Sas and the number / may (after 


a certain N) be made less (in absolute value) than any positive 
number, in particular less than q—lJ; that is, 


ae 


Inequality (2’) follows from this last inequality. Writing ine- 
quality (2’) for various values of n, from N onwards, we get 


Uyn+ı < Guy 
Un+2 < Jung < Quy (3) 
UN+3 < JUN+z < Quy 
Now consider the two series 
Utu Hust... HUn Unti t Unst.. (1) 
PE N (1’) 


The series (1’) is a geometric progression with positive common 
ratio q< 1. Hence, this series converges. The terms of the 


q- q-l L-1 L-i 
aH e—a” 
lu ad 1 1 u A L. 

T Tn 
Fig. 109 Fig. 110 


series (1), after uy,,, are less than the terms of the series (1’). 
By Theorem 1, Sec. 4.3, and Theorem 1, Sec. 4.1, it follows that 
the series (1) converges. 


it follows that, after a certain N, that nt n> N, we will have 
the inequality 


Un 
ree, 


(Fig. 110), or u,,,>4, for all n>N. But this means that the 
terms of the series increase after “the term N-+1, and tor this 
reason the general term of the series does not tend to zero. Hence, 
the series diverges. 
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Note 1. The series will also diverge when lim =+ =œ. This 


n>o n 


follows from the fact that if lim = = œo, then after a certain 


n>e n 
n=N we will have the inequality fti y l, Or Un41 > Up: 
n 


Example 1. Test the followirig series for convergence: 
I | l 
l+ratrza t e trag nat] 


Solution. Here, 


1 1 1 1 
=g na n “SES... nati nii 


Hence, 


u 1 
im ZH lim — =0 < l 
Jim: Un n= œ n+l 


The series converges. 
Example 2. Test for convergence the series 


2 2? P 2n 
Ttytat. tet. 
Solution. Here, 
Qn 2n+1 


u,=— u =e 
n n’ n+i n+l’ 


Un+1__9 Unti -B 9 
Un =a TT Am ün = im ay >l 


The series diverges and its general term u„ approaches infinity. 


Note 2. D’Alembert’s test tells us whether a given positive 
series converges; but it does so only when lim “+! exists and is 


noe n 


different from 1. But if this limit does not exist or if it does 
exist and lim “#+!—1, then d’Alembert’s test does not enable us 


to tell whether the series converges or diverges, because in this 
case the series may prove to be both convergent and divergent. 
Some other test is needed to determine the convergence of such 
series. 

Note 3. If lim Mutt =I, but the ratio sett for all n (after a 


nan a n 


certain one) is greater than unity, the series diverges. This follows 
from the fact that if <tt> 1, then u,,,>u, and the general 


n 
term does not approach zero as n — oo. 
To illustrate, let us examine some examples. 
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Example 3. Test for convergence the series 
1 2 3 n 
gtat at eee Tait eoe 


Solution. Here, 


n+! 
2 
lim !@t2— jim 212 = lim Atl] 
nro Un N+ n n= n?+ 2n 
n+l 
Unt 


In this case the series diverges because ee 1 for all n: 
a 


Une,  n®?4-2n+1 


Uns n?+2n ae 


Example 4. Using the d’Alembert test, examine the harmonic series 


ltetete tobe. 


We note that u=}, umns=7 and, consequently, 
u n 
li att __ li —— =l 
Pye Un ee n+l 


Thus, d’Alembert’s test does not allow us to determine the convergence or 
divergence of the given series. But we earlier found out by a different expedient- 
that a harmonic series diverges. 

Example 5. Test for convergence the series 


l 1 1 1 
Tataagtzqt:: trapit vee 


Solution. Here, 
l l 
Haan ly’? H Ta) (nd) 
, g 1) g n 
lim Het im AED) a lim 1 
nee Un  ns»(nFI)(n+2) n»ont2 
D’Alembert’s test does not permit us to infer that the series converges; 


but by other reasoning we can establish the fact that this series converges. 
Noting that 


we can write the given series in the form 
rt — 4 2 Gan oe 2 Gee E ( l 1) 
(1-7)+(7-3 \+(g-g)+--+(g-ma}te 
The partial sum of the first n terms, after removing brackets and cancell- 
ing, is 


=e 
n+! 


Srn=l1— 
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Hence, 
A . l 
dim sam lm (1— pya )=! 


that is, the series converges and its sum is 1. 


4.5 CAUCHY’S TEST 


Theorem (Cauchy’s test). /f for a series with positive terms 
_ U, +u, tH Ust... tun... (1) 
the quantity j/u, has a finite limit | as n— œ, that is, 
lim j/u, =l 
nae 
then: (1) for L< tł, the series converges 
(2) for Lœ 1, the series diverges. 
Proof. (1) Let ¿< 1. Consider the number q that satisfies the 


relation l<q<l. 
After some n=WN we will have the relation 


|Wu,—l|<q—l 
whence it follows that _ 
VW Un<q 
or 
Un < q” 


for all n>N. 
Now consider two series: 
U, +u tug... Huy t Uyt tinge t.. (1) 
qy Hart Hg... (1’) 
The series (1°) converges, since its terms form a decreasing 
geometric progression. The terms of the series (1), after uy, are 
less than the terms of the series (1’). Consequently, the series (1) 


converges. 
(2) Let />1. Then, after some n= N, we will have 


Vu,>1 
u, > 1 


But if all the terms of this series, after uy, exceed 1, then the 
series diverges, since its general term does not tend to zero. 


or 


Example. Test for convergence the series 


14(8)+(3)+-+(ata) + 
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Solution. Apply the Cauchy test: 


n n n ; n 1 
aim n V un= lim y (zn) = lim rg <! 
The series converges. 


Note. As in the d'Alembert test, the case 
lim yu, =/= 1 


no 
requires further investigation. Among the series that satisfy this 
condition are convergent and divergent series. Thus, for the har- 
monic series (which is known to be divergent) 


lim Vu, = lim Vra 


To be sure, we shall prove that lim In j/i- 0. Indeed, 


nao 
zu 
lim In V1=1im 
n> n>n 


Here, the numerator and denominator of the fraction approach 
infinity. Applying |’Hospital’s rule, we find 


1 
fiin Vi- lim =t lim =" =0 


no n= 0 l 


Thus, n4 1—0, but then eee Ee, 


n>n 


n 
For the series 


Itata t tit. 


we also have the equality 


Jim y u, = lim Vi- lim = 1 Tei 


but this series converges, since if we suppress the first term, the 
terms of the remaining series will be.less than the corresponding 
terms of the converging series 


1 1 l 
ratga te taat 
(see Example 5, Sec. 4.4), 
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4.6 THE INTEGRAL TEST FOR CONVERGENCE 


OF A SERIES 
Theorem. Let the terms of the series 
Uy Uy Ust... Hurt. (1) 
be positive and nonincreasing, that is, 
U, IUU... (1°) 
and let f(x) be a continuous nonincreasing function such that 
FO)=u, F(2)=u, ..., f(n) =ü (2) 


Then the following assertions hold true: 
(1) if the improper integral 
f f (x) dx 
1 
converges (see Sec. 11.7, Vol. I), then the series (1) converges too; 
(2) if the given integral diverges, then the series (1) diverges 
as well. 


NS 
123 / 
Fig. 111 Fig. 112 


Proof. Depict the terms of the series geometrically by plotting 
on the x-axis the terms 1, 2, 3, ..., n, n+1, ... of the series, 
and on the y-axis, the corresponding values of the terms of the 
series U, Up, ..., Uy, ... (Fig. 111). 

In the same coordinate system plot the graph of the continuous 
nonincreasing function 

y=f(x) 


which satisfies condition (2). 

An examination of Fig. 111 shows that the first of the construct- 
ed rectangles has base equal to 1 and altitude f(l)=u, The 
area of this rectangle is thus u,. The area of the second one is u,, 
and so on; finally, the area of the last (nth) of the constructed 
rectangles is u,. The sum of the areas of the constructed rectangles 


4.6 The Integral Test for Convergence of a Series 267 


is equal to the sum s, of the first n terms of the series. On the 
other hand, the step-like figure formed by these rectangles embraces 
a region bounded by the curve y=f(x}, and the straight lines 
x==1, x=n+1, y=0; the area of this region is equal to 
n+l 

| f(x) dx. Hence, 


1 
n+l 


Sn > f f (x) dx (3) 
1 


Let us now consider Fig. 112. Here the first of the constructed 
rectangles on the left has altitude u,; and so its area is uy. 
The area of the second rectangle is u,, and so forth. The area 
of the last of the constructed rectangles is u,,,. Hence, the sum 
of the areas of all constructed rectangles is equal to the sum of 
all terms of the series beginning with the second to the (n+1)th 
or S,,,—U,. On the other hand, it is readily seen that the step- 
like figure formed by these rectangles is contained within the 
curvilinear figure bounded by the curve y==/(x) and the straight 
lines x= 1, x=n-+1, y=0. The area of this curvilinear figure is 

n+l 


equal to f f (x) dx. Hence, 
i 


n+l 


Sparta < | f(x)dx 
1 
whence 
n+l 
Sarı < | FO de tu, (4) 
1 
Let us now consider both cases. 
l. We assume that the integral | fF (x)dx converges, that is, 
1 
has a finite value. 


Since 
n+l 


| Fide < Sf @ade 
1 1 
it follows, by virtue of inequality (4), that 
Sa < Sasi < | F(x) dr +u, 
1 


Thus, the partial sum s, remains bounded for all values of n. 
But it increases with increasing n, since all the terms uw, are 
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positive. Consequently, s, (as n-+ oo) has the finite limit 
lims, =s 
and the series converges. 


2 


2. Assume, further, that | F œ) dx = œ. This means that 


1 
n+l 


f f(x)dx increases without bound as n increases. But then, by 


1 
virtue of inequality (3), s, likewise increases indefinitely with n; 
the series diverges. 

The proof of the theorem is complete. 

Note. This- theorem remains valid if inequalities (1’) are ful- 
filled only from some integer N onwards. 


Example. Test for convergence the series 
1 1,1 1 
jp tgp tat: typ te 
Solution. Apply the integral test, putting 
1 
F()=z 
This function satisfies all the conditions of the theorem. Consider the integral 


N ( 1 N 1 

de Ael =~—— (N!-P —1) when p #1 
(S- l—p Pp 

xP 
1 


1 l— 
Inx |! =InN when p=! 
Allow N to approach infinity and determine whether the improper integral 
converges in various cases. 


It will then be possible to judge about the convergence or divergence of the 
series for various values of p. 


For p> 1, (Z= the integral is finite and, hence, the series 
ï 
converges; i 


e 
for p<!l, (Z=, the integral is infinite, and the series diverges; 
1 


O 
for p=1, (Z=, the integral is infinite, and the series diverges. 


1 
We note that neither the d’Alembert test nor the Cauchy test, which were 
considered earlier, decide whether the series is convergent or not, since 


uU ; n \P 
lim +1 — lim (5) =Í 
n+o Un n+o\n-+ | 


n/f— n ar a n T P 
i in= li — =li (Vt) = 1? =] 
Tim Vusi V alin (V5 
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4.7 ALTERNATING SERIES. LEIBNIZ’ THEOREM 


So far we have been considering series whose terms are all 
positive. In this section we consider series whose terms have 
alternating signs, that is, series of the form 


Uy—U,+U;s—Ut+... 


where u,, Uy, ..., Ups ... are positive. 
Leibniz’ Theorem. /f in the alternating series 
u,—u,tu,—u,+... (u, >) (1) 
the terms are such that 
U, > U > U>... (2) 
and 
lim u, =0 (3) 


then the series (1) converges, its sum is positive and does not exceed 
the first term. 
Proof. Consider the sum of the first n -= 2m terms of the series (1): 
Som = (Uy — Uz) + (Us — Ua) + - «+ (Uem-1 — Uam) 


From condition (2) it follows that the expression in each of the 
brackets is positive. Hence, the sum s,,, is positive, 


Sam > 0 
and increases with increasing m. Now write this sum as follows: 
Som = U, — (Ug — Us) — (Ug — Ug) — - .  -— (Uam-2— Uam—1) — Yam 


By virtue of condition (2), each of the parentheses is positive. 
Therefore, subtracting these parentheses from u, we get a number 
less than u,, or 

Som < Uy 


We have thus established that s,,, increases with increasing m 
and is bounded above. Whence it follows that s,,, has the limit s: 


lim Sem =S 
maw 

and 
0<s<u, 


However, we have not yet proved the convergence of the series; 
we have only proved that a sequence of “even” partial sums has 
as its limit the number s. We now prove that “odd” partial sums 
also approach the limit s. 

Consider the sum of the first n=2m-+1 terms of the series (1): 


Samts = Sam T Urme1 
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Since, by condition (3), lim u,,,,,=0, it follows that 
m>oa 
lim Samy, = lim Som + lim Uomi = lim Som =S 
m>n moe mM>o m>o 


We have thus proved that lims,=s both for even n and for 


n>@ 
odd n. Hence, the series (1) converges. 

Note 1. The Leibniz theorem holds if inequalities (2) hold true 
from some N onwards. 

Note 2. The Leibniz theorem may be illustrated geometrically 
as follows. Plot the following partial sums on a number line 
(Fig. 113) 

S= Uy, Sa =U, — Ug = S— Ug Sy=SptUg, Sy=Sy—Uy, Sg = S, +H Us, 
etc. 

The points corresponding to partial sums will approach a certain 
point s, which depicts the sum of the series. Here, the points 
corresponding to the even 
partial sums lie on the left of 
s, and those corresponding 
to odd sums, on the right 
of s. 

Note 3. If an alternat- 
ing series satisfies the state- 
ment of the Leibniz theo- 

Fig. 113 rem, then it is easy to eva- 

luate the error that results 

if we replace its sum, s, by the partial sum s,. In this substi- 

tution we suppress all terms after u,,,. But these numbers form 

by themselves an alternating series, whose sum (in absolute value) 

is less than the first term of this series (that is, less than u,,,). 

Thus, the error obtained when replacing s by s, does not exceed 
(in absolute value) the first of the suppressed terms. 


Example 1. The series 


5, 5, 5g S 55 55 SU, 


converges, since (1) 1 > 4 > $ >...; (2) lim u,= lim L=. 
nwo nwo 


The sum of the first n terms of this series 
1 1 1 1 
Salas tz eget 
1 
n+l’ 


differs from the sum s of the series by a quantity less than 


Example 2. The series 
l l l 
lea ea a 


converges by virtue of the Leibniz theorem. 
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4.8 PLUS-AND-MINUS SERIES. 
ABSOLUTE AND CONDITIONAL CONVERGENCE 


We give the name plus-and-minus serfes to a series that has 
both positive and negative terms. 

Obviously, the alternating series considered in Sec. 4.7 is a 
special case of plus-and-minus series. * 

We shall consider some properties of alternating series. 

In contrast to the agreement made in the preceding section we 
will now assume that the numbers u,, Us, ..., Up ... can be both 
positive and negative. 

First, let us give an important sufficient condition for the con- 
vergence of an alternating series. 

Theorem 1. /f the alternating series 


u, +u, +. .tu,+... (1) 
is such that a series made up of the absolute values of its terms 
lult] u| +. linl t (2) 


converges, then the given alternating series also converges. 

Proof. Let s, and o, be the sums of the first n terms of the 
series (1) and (2). 

Also, let sp be the sum of all the positive terms, and s}, the 
sum of the absolute values of all the negative terms of the first 
n terms of the given series; then 


Sn = Sn — Sp» On = Sn t Sn 


By hypothesis, o, has the limit o; s, and s, are positive in- 
creasing quantities less than o. Consequently, they have the 
limits s’ and s”. From the relationship s,=s,—s, it follows that 
s, also has a limit and that this limit is equal to s’—s’, which 
means that the alternating series (1) converges. 

The above-proved theorem enables one to judge about the con- 
vergence of certain alternating series. In this case, testing the 
alternating series for convergence reduces to investigating a series 
with positive terms. 

Consider two examples. 


Example 1. Test for convergence the series 


sina , sin2a , sin3a sin na 


pe gt He 


where œ is any number. 


Jesi (3) 


* In this English edition we shall use the term alternating series for both 
types.—Tr. 
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Solution. Also consider the series 


sina sin 2a sin 3a sin na 
ne | +] Sort +] Set [+ +] Se | a 
and i 
1 l 1 1 
jetortart:.-t prt: (5) 


The series (5) converges (see Sec. 4.6). The terms of the series (4) do not 
exceed the corresponding terms of the series (5); hence, the series (4) also con- 
verges. But then, in virtue of the theorem just proved, the given series (3) 
likewise converges. 

Example 2. Test for convergence the series 


n 3n 5n (2n —1) a 
cos T cos TT cos F cos -F 7 
=a tga h-a heet gpa ma (6) 
Solution. In addition to this series, consider the series 
l l 1 l l 
tartar te tger te (7) 


This series converges because it is a decreasing geometric progression with 
ratio But then the given series (6) converges, since the absolute values 
of its terms are less than those of the corresponding terms of the series (7). 


We note that the convergence condition that was proved earlier 
is only a sufficient condition for convergence of an alternating 
series, but not a necessary condition: there are alternating series 
which converge, but series formed from the absolute values of 
their terms diverge. In this connection, it is useful to introduce 
the concepts of absolute and conditional convergence of an alter- 
nating series and, on the basis of these concepts, to classify alter- 
nating series. 

Definition. The alternating series 


Utu, +u, +... Hurt... (1) 


is called absolutely convergent if a series made up of the absolute 
values of its terms converges: 


Jul +l u| + lusi +... +lunl+-.- (2) 


If the alternating series (1) converges, while the series (2) com- 
posed of the absolute values of its terms diverges, then the given 
alternating series (1) is called a conditionally convergent series. 


Example 3. The alternating series 
1 l l 
Rp ge gte 


is conditionally convergent, since a series composed of the absolute values of 
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its terms is a harmonic series, 
l I 1 
lfytatgt.. 
which diverges. The series itself converges (this can be readily verified by 


Leibniz’ test). 
Example 4. The alternating series 


l l 1 
l-g ty gt 


is absolutely convergent, since a series made up of the absolute values of its 
terms, 


l l l 
ior tg tat 
converges, as established in Sec. 4.4. 


Theorem 1 is frequently stated (with the help of the concept 
of absolute convergence) as follows: every absolutely convergent 
series is a convergent series. 

In conclusion, we note (without proof) the following properties 
of absolutely convergent and conditionally convergent series. 

Theorem 2. /f a series converges absolutely, it remains abso- 
lutely convergent for any rearrangement of its terms. The sum of 
the series is independent of the order of its terms. 

This property does not hold for conditionally convergent series. 

Theorem 3. /f a series converges conditionally, then no matter 
what number A is given, the terms of this series can be rearranged 
in such manner that its sum is exactly equal to A. What is more, 
it is possible so to rearrange the terms of a conditionally conver- 
gent series that the series resulting after the rearrangement is di- 
vergent. 

The proof of these theorems is outside the scope of this course, 
and can be found in more fundamental texts (see, for example, 
G. M. Fikhtengolts, “Course of Differential and Integral Calculus”, 
1962, Vol. II, pp. 319-320, in Russian). 

To illustrate the fact that the sum of a conditionally convergent 
series can change upon rearrangement of its terms, consider the 
following example. 


Example 5. The alternating series 
1 l t, 
l-t gt (8) 
converges conditionally. Denote its sum by s. It is obvious that s > 0. Rearrange 
the terms of the series (8) so that two negative terms follow one positive term: 


1 | | 1 1 1 1 1 
iSg ata 6 Tg te tai aa RT (9) 


We shall prove that the resultant series converges, but that its sum s’ is 


18—2082 
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half the sum of the series (8): that is, +s. Denote by s, and sp the partial 
sums of the series (8) and (9). Consider the sum of 3k terms of the series (9): 


asiti) 

~(i) litja) 
kCt) 

A e e 


Consequently, 


Further, 


; š ` , 1 1 
lim = lim =— 
kw te ene ( setae | 2 s 
; 7 x , l 
lim = lim £ ea N 
‘eee lim, ( tari mea) TS 
And we obtain 
, 1 
lim sa = S' = — 
n>a” 2 a 


Thus, in this case the sum of the series changed after its terms were 
rearranged (it diminished by a factor of 2). 


4.9 FUNCTIONAL SERIES 


A series.u,tu,+...-+u,+... is called a functional series 
(or series of functions) if its terms are functions of x. 
Consider the functional series 


u, (x) +u, (x) + ua (x) +... Hun (t. (1) 


Assigning to x definite numerical values, we get different nume- 
rical series, which may prove to be convergent or divergent. 

The set of all those values of x for which the functional series 
converges is called the domain of convergence of the series. 

Obviously, in the domain of convergence of a series its sum is 
some function of x. Therefore, the sum of a functional series is 
denoted by s(x). 


Example. Consider the functional series 


lxt xt... panpe, 
This series converges for all values of x in the interval (—1, 1), that is, 
for all x that satisfy the condition |x| < 1. For each value of x in the interval 


(—I, 1), the sum of the series is equal to 


= (the sum of a decreasing geo- 
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metric progression with ratio x). Thus, in the interval (—1, 1) the given series 
defines the function i 

s=; 
which is the sum of the series; that is, 


ppaltetettet... 


Denote by s, (x) the sum of the first n terms of the series (1). 
If this series converges and its sum is equal to s(x), then 


S (x) = Sn (x) + rn (x) 
where r,,(x) is the sum of the series u,,,(*)+Un+,(x)+..., Le., 
Ty (X) = Uns, (X) + Unse (x)+... 


Here, the quantity r, (x) is called the remainder of the series (1). 
For all values of x in the domain of convergence of the series we 
have the relation lims, (x)= s (x); therefore, 

aoe 


lim r,, (x) = lim [s(x)—s, (x)] =0 


which means that the remainder r,(x) of a convergent series ap- 
proaches zero as n — oo. 


4.10 DOMINATED SERIES 
Definition. The functional series 
u, (x) + Uy (x) + Us (x) +... +, (x) +... (1) 


is called dominated in some range of x if there exists a conver 
gent numerical series 


Q,-+a,+a,+...fa,+... (2) 
with positive terms such that for all values of x from this range 
the following relations are fulfilled: 

lui (|< ta (x)|<a,, ..., lta (OIKA -.. (3) 


In other words, a series is called dominated if each of its terms 
does not exceed, in absolute value, the corresponding term of some 
convergent numerical series with positive terms. 
For example, the series 
cosx , cos 2x , cos 3x cos nx 


a ee ASEH.. 


is a series dominated on the entire x-axis. Indeed, for all values 


18 * 
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of x, the relation 


cos nx 
nè? 


1 
ep Abas Op asc) 


is fulfilled and the series 
] 1 1 
Itat zt ese 
as we know, converges. 

From the definition it follows straightway that a series domina- 
ted in some range converges absolutely at all points of this range 
(see Sec. 4.8). Also, a dominated series has the following important 
property. 

Theorem. Let the functional series 

u (x) fe (X) +... Fay (x) $n. 
be dominated on the interval [a, b]. Let s(x) be the sum of this 
series and s,,(x) the sum of the first n terms of this series. Then 
for each arbitrarily small number © >0 there will be a positive 


integer N such that for all n>N the following inequality will be 
fulfilled, 


[s (x) —S, (x) | <e 
no matter what the x of the interval [a, b]. 
Proof. Denote by o the sum of the series (2): 


O=4,4+0,+4,+...1+4, 14,4, +.-. 
then 
O-=0, + En 
where o, is the sum of the first n terms of the series (2), and e, 
is the sum of the remaining terms of this series; that is, 
En = Anti F Onia F.o 


Since this series converges, it follows that 


lim o, =o 
n> D 

and, consequently, 
lim e,=0 
n> O 


Let us now represent the sum of the functional series (1) in the 
form 
S (x) = Sq (X) + Fn (x) 


S, (x) =u, (x) +...+4, (x) 
Ta(X) = Une (X) +g ae (X) + Unsa (x) +... 


where 
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From condition (3) it follows that 
(unta (x) | T | Ua +2 (x) | Sansa anes 


and therefore E 
Ir, (x)|<e, 


for all x of the range under consideration. 
Thus, 
|s (x)—s, (x) | < En 


for all x of the interval [a, b], and €, — 0 as n — œ. 

Note 1. This result may be represented geometrically as follows. 

Consider the graph of the function y= s(x). About this curve 
construct a band of width 2e„; in other words, construct the curves 
y=s(x)+e, and y=s(x)—e, y 
(Fig. 114). Then for any e, the 
graph of the function s, (x) will 
lie completely in the band under 
consideration. The graphs of all 
successive partial sums will 
likewise lie within this band. 

Note 2. Not every functional 
series convergent on the interval 
[a, b] has the property indicated 
in the foregoing theorem. How- 
ever, there are nondominated se- Fig. 114 
ries such that possess this pro- £- 
perty. A series that possesses this property is called a uniformly 
convergent series on the interval [a, b]. 

Thus, the functional series u,(x)+u,(x)+...+u,(x)+... is 
called a uniformly convergent series on the interval [a, b] if for 
any arbitrarily small ¢>0 there is an integer N such. that for 
all n>N the inequality 


|s{x)—s, (x)| < € 
will be fulfilled for any x of the interval [a, b]. 


From the theorem that has been proved it follows that a domi- 
nated series is a series that uniformly converges. 


4.11 THE CONTINUITY OF THE SUM OF A SERIES 
Let there be a series made up of continuous functions 
u, (x) + uy (x) +... + uy (x) +. 


convergent on some interval fa, b). 
In Chapter 2, Vol. I, we proved a theorem which stated that 
the sum of a finite number of continuous functions is a continuous 
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function. This property does not hold for the sum of a series con- 
sisting of an infinite number of terms. Some functional series with 
continuous terms have for the sum a continuous function, while 
in the case of other functional series with continuous terms, the 


sum is a discontinuous function. 
Example. Consider the series 


(pete sets We cree BO Orr eer Ag 


The terms of this series (each term is bracketed) are continuous functions for 
all values of x. We shall prove that this series converges and that its sum 
is a discontinuous function. 


Fig. 115 


We find the sum of the first n terms of the series: 
1 
ant. 


Sn=x x 
Find the sum of the series: 
if x > 0, then 
1 
s= lim s, (x)= lim (ataa 
n> n> o 
if x < 0, then 
1 
s= lim s, (x)= lim E Ta --% 
n> o n> o 


if x=0, then s„=0, and so s= lim s =0. Thus, we have 
n> O 
s(x) =—l—x for x<0 
s(x)=0 for x=0 
S(x)=1—x for x>0 
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And so the sum of the given series is a discontinuous function. Its graph is 
skown in Fig. 115 along with the graphs of the partial sums s, (x), sp(x), 
and sy (x). 


The following theorem holds true for dominated series. 

Theorem. The sum of a series (of continuous functions) dominated 
on some interval [a, b] is a function continuous on that interval. 

Proof. Let there be a series of continuous functions that is do- 
minated on the interval [a, b]: 


u, (x) + Uy (x) + us (x) +... (1) 

Let us represent its sum in the form 
s (x) = S, (x) + Tn (x) 

where 

Sn (x) =u, (x) +--+ + Uy (x) 
and 

Tn (x)= Unti (X) + Una, (a) +- 
On the interval [a, b] take an arbitrary value of the argument 

x and give it an increment Ax such that the point x+ Ax also 


lies on the interval [a, b]. 
We introduce the notation 


As = s(x + Ax) —s (x) 
As, = Sn (x + Ax)—s, (x) 
then 
As = AS, + r, (x+Ax)—r, (x) 


from which we have 
| As| <| As, |+| 7, (x+ Ax)|+]7, (x)| (2) 


This inequality is true for any integer n. 

To prove the continuity of s(x), we have to show that for any 
preassigned and arbitrarily small e>0 there will be a number 
6>0 such that for all | Ax| <ô we will have |As| <e. 

Since the given series (1) is dominated, it follows that for any 
preassigned e > 0 there will be found an integer N such that for 
all nN (and as a particular case, n= N} the inequality 


Irv <5 (3) 


will be fulfilled for any x of the interval [a, b]. The value x+ Ax 
lies a the interval [a, 6] and therefore the following inequality 
is fulfilled: 


Iry(x+ Ax) |< (3') 
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Further, for the chosen N the partial sum sy(x) is a continuous 
function (the sum of a finite number of continuous functions) and, 
consequently, a positive number 6 may be chosen such that for 
every Ax that satisfies the condition |Ax|<5 the following 
inequality is fulfilled: 


By inequalities (2), (3), (3’), and (4), we have 


PAN e e 
|As| <5 t5 t3 =E 
that is, 
ļlAs| <e for |Ax]<6 


which means that s(x) is a continuous function at the point x 
(and, consequently, at any point of the interval [a, b]). 

Note. From this theorem it follows that if the sum of a series 
is discontinuous on some interval [a, b], then the series is not 
dominated on this interval. In particular, the series given in the 
Example is not dominated on any interval containing the point 
x=0, that is to say, a point of discontinuity of the sum of the 
series. 

We note, finally, that the converse statement is not true: there 
are series, not dominated on an interval, which, however, converge 
on that interval to a continuous function. For instance, every 
series uniformly convergent on the interval [a, b] (even if it is not 
dominated) has a continuous function for its sum (if, of course, 
all terms of the series are continuous). 


4.12 INTEGRATION AND DIFFERENTIATION OF SERIES 


Theorem 1. Let there be a series of continuous functions 
uy (x) $y (X) +... +i (XH... (1) 


dominated on the interval [a, b] and let s(x) be the sum of the 
series. Then the integral of s(x) from a to x, which limits belong 
to the interval [a, b], is equal to the sum of the integrals of the 
terms of the given series; that is, 


or (at S uy (Qdtt.. + Sug T 


a a a 


Proof. The function s(x) may be represented in the form 
s (x) = Sa (x) + fn (x) 
5 (x) = u, (x) + u (X) Ee + Un (x) + rn (x) 


or 
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Then 
Ç s()adt= f u (Ddt+ |u (dt... tf up (t)dt +r, (t) dt (2) 


(the integral of the sum of a finite number of terms is equal to 
the sum of the integrals of these terms). 

Since the original series (1) is dominated, it follows that for 
every x we have |r, (x)| < En, where e, -+ 0 as n — ov. Therefore, * 


x x x 
Frainae| <a {rato ia < + | e„dt = + e, (x—a) <e,(b—2) 
a a a 


Since e, — 0, it follows that 
x 


lim Vr (t)dt =0 
n> Ty 


But from equation (2) we have 
x 


noas jsod- futwa... +iuna] 


Hence 
, x x x ) 
lim { | s()dt—| | u ()dt+... +| un (dt = 
ot a a a 
x x x 
lim [buddy + Gu nat | =| s(t) dt (3) 
The sum in the brackets is a partial sum of the series 
x x 
fu (dt+...4+) u, (dit... (4) 
a a 


Since the partial sums of this series have a limit, this series 
converges and its sum, by virtue of equation (3), is equal to 
x 


(s(t)dt, i.e., 


a 


{ s(ydt =F uy (dt+§ ug (det... +6 uy (t)dt-+ ae 


This is the equation that had to be proved. 


* In the estimates given below we take the + sign for a < x and the — sign 
for x < a. 
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Note 1. If a series is not dominated, term-by-term integration 
of it is not always possible. This is to be understood in the sense 
x 


that the integral ( s(t)at of the sum of the series (1) is not always 


equal to the sum of the integrals of its terms [that is, to the sum 
of the series (4)]. 
Theorem 2. /f a series 


u, (x) + Uy (x) +... +u (x) +... (5) 


made up of functions having continuous derivatives on the interval 
[a, b] converges (on this interval) to the sum s(x) and the series 


ui (x) + Uy (x) +... Hun) (6) 


made up of the derivatives ‘of its terms is dominated on the same 
interval, then the sum of the series of derivatives is equal to the 
derivative of the sum of the original series; that is, 


S (x) = Uy (x) + Ug (x) + us (x) +... + Un (x) H. 
Proof. Denote by F(x) the sum of the series (6): 
F (x) = uj (x) tug (x) +... tut... 
and prove that 
F (x) =s' (x) 


Since the series (6) is dominated, it follows, by the preceding 
theorem, that 


E T O T E 


Performing the integration, we get 


\ F) dt = [u (x)—u, ()] 


+ [Us (x) — ua (%)] +... + [un (*)— un (@)] +. 
But, by hypothesis, 
5 (2) =u, (#) + Hp (X) +o Hl). 
s(a) =u, (a) +u: (a) +... +u, (a) +... 


no matter what the numbers x and æ on the interval fa, b]. 
Therefore, 


| F (t) dt =s(x)—s (a) 
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Differentiating both sides of this equation with respect to x, 

we obtain 

F (x) =s’ (x) 
We have thus proved that when the conditions of the theorem 
are fulfilled, the derivative of the sum of the series is equal to 
the sum of the derivatives of the terms of the series. 

Note 2. The requirement of dominance (majorization) of a series 
of derivatives is extremely essential, and if not fulfilled it can 
make term-by-term differentiation of the series impossible. This is 
illustrated by a dominated series that does not admit term-by-term 
differentiation. 

Consider the series 

in 14 sin 24x , sin 34x sin nix 

ne a es tt 
This series converges to a continuous function because it is 
dominated. Indeed, for every x its terms are (in absolute value) 
less than the terms of the numerical convergent series with 
positive terms 


thotate tate. 
Write a series composed of the derivatives of the terms of the 
original series: 
cos x + 22 cos 2tx + ...+n?cosntx+... 
This series diverges. Thus, for instance, for x=0 it turns into 


the series 
14224+39+...+n?+... 
(It may be shown that it diverges not only for x=0.) 


4.13 POWER SERIES. INTERVAL OF CONVERGENCE 
Definition 1. A power series is a functional series of the form 


Ay + A,X + a,x? +... 4+ayx" +... (1) 


where a, Qis Qz, ..-, Am ... are constants called coefficients of 
the series. 

The domain of convergence of a power series is always some 
interval, which, in a particular case, can degenerate into a point. 
To convince ourselves of this, let us first prove the following theorem, 
which is very important for the whole theory of power series. 

Theorem 1 (Abel’s theorem). (1) /f a power series converges for 
some nonzero value x,, then it converges absolutely for any value 
of x, for which 

[xI < [xol 
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(2) if a series diverges for some value x, then it diverges for every 
x for which 


|x] > lx] 
Proof. (1) Since, by assumption, the numerical series 
Ay + A,X) + aaxi+...4-a,x¢+... (2) 


converges, it follows that its common term a„xọ—>0 as n— œ, 
and this means that there exists a positive number M such that 
all the terms of the series are less than M in absolute value. 
Rewrite the series (1) in the form 
2 n 
Qo +4:X0 (=) +a,x3 (=) +... Haa ( Z) +... (3) 
and consider a series of the absolute values of its terms: 
2 n 
la|+la.xol|2]+laees Zi. Hal 4) 


The terms of this series are less than the corresponding terms 
of the series 


M+M|Ż]+ MIZ... +M F 6) 


For |x|<|x,| the latter series is a geometric progression with 
ratio a <1 and, consequently, converges. Since the terms of the 


0 
series (4) are less than the corresponding terms of the series (5), 
the series (4) also converges, and this means that the series (3) 
or (1) converges absolutely. 

(2) It is now easy to prove the second part of the theorem: let 
the series (1) diverge at some point x. Then it will diverge at 
any point x that satisfies the condition |x] > |x|. Indeed, if at 
some point x that satisfies this condition the series converged, then, 
by virtue of the first part (just preyed) of the theorem, it should 
converge at the point x, as well, since |x| < |x]. But this con- 
tradicts the condition that at the point x, the series diverges. 
Hence the series diverges at the point x as well. The theorem is 
thus completely proved. 

Abel’s theorem makes it possible to judge the position of the 
points of convergence and divergence of a power series. Indeed, 
if x, is a point of convergence, then the entire interval (—|x,|, 
|x, |) is filled with points of absolute convergence. If x, is a point. 
of divergence, then the whole infinite half-line to the right of the 
point |x,| and the whole half-line to the left of the point — | xs | 
consist of points of divergence. 

From this it may be concluded that there exists a number R 
such that for |x| < R we have points of absolute convergence and 
for |x| >R, points of divergence. 


x 
Xo 


x 
Xo 


x x 
Xo Xo 
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We thus have the following theorem on the structure of the 
domain of convergence of a power series: 

Theorem 2. The domain of convergence of a power series is an 
interval with centre at the coordinate origin’ 

Definition 2. The interval of convergence of a power series is an 
interval from —R to +R such that for any point x lying inside 
this interval, the series converges and converges absolutely, while 


series converges 
-R R 


—m ne . . 
Series diverges series diverges 


Fig. 116 


for points x lying outside it, the series diverges (Fig. 116). The 
number R is called the radius of convergence of the power series. 

At the end points of the interval (at x=R and at x=— R) the 
question of the convergence or divergence of a given series is 
decided separately for each specific series. 

We note that in some series the interval of convergence dege- 
nerates into a point (R=0), while in others it encompasses the 
entire x-axis (R = 00). 

We give a method for determining the radius of convergence of 
a power series. 

Let there be a series 


Ay + a,x 4-a,x?+...+a,x"+... (1) 
Consider a series made up of the absolute values of its terms: 
Ja, |-+]a,{|*|+]a.|]*?+]as| |x) 
+la|[xPt...+]alle +... (6) 
To determine the convergence of this series (with positive terms!), 
apply the d’Alembert test. 
Let us assume that there exists a limit: 
On 1xttl 
a,x" 


. u . 
lim == = lim 
n= n n> o 


Then, by the d’Alembert test, the series (6) converges, if L|x| < 1; 
that is, if |x| <+, and diverges if L|x]>1, that is, if |x| >z- 


n> o 


an+1 
an 


|x|=L|x| 


Consequently, series (1) converges absolutely when | x| < ae But 


if |x| SGN then jim “t= 22 > 1 and series (6) diverges, and 
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its general term does not tend to zero.* But then neither does 
the general term of the given power series (1) tend to zero, and 
this means that (on the basis of the necessary condition of con- 


vergence) this power series diverges (when |x| >t): 

From the foregoing it follows that the interval (—z. T) is 
the interval of convergence of the power series (1), i.e., 

an 
On+1 


R=+= lim 


n> o 


Similarly, to determine the interval of convergence we can make 
use of the Cauchy test, and then 


1 
lim “fal 
am, V lanl 


Example 1. Determine the interval of convergence of the series 


l+xefxPtx84..,. +484... 
Solution. Applying d’Alembert’s test directly, we get 


ati 


lim zi 


ñ => o 


=|x] 


Thus, the series converges when |x|< 1 and diverges when |x| > 1. At 
the extremities of the interval (—1, 1) it is impossible to investigate the 
series by means of d’Alembert’s test. However, it is immediately apparent 
that when x=—1 and when x=1 the series diverges. 

Example 2. Determine the interval of convergence of the series 


2x (2x)? _, (2x)? 
[a go 


Solution. We apply the d’Alembert test: 


(2x)n+1 
7 n+l |_,, n an 
| a =, ap = 
n 


The series converges if |2x| <1, that is, if |x| < 5: when rot the series 


converges; when aai the series diverges. 


Example 3. Determine the interval of convergence of the series 
xL x8 xn 
eta tayt tat eee 


* It will be recalled that in proving d’Alembert’s test (see Sec. 4.4) we 


found that if lim “nth > 1, then the general term of the series increases and, 


consequently, does not. tend to zero. 
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Solution. Applying the d’Alembert test, we get 


Uns+i 
Un 


xn+in! i 
——_ 7 J = L 
x" (n+ I)! | new 


Since the limit is independent of x and is less than unity, the series con- 
verges for all values of x. 

Example 4. The series 1-+x--(2x)?+ (3x) + ...-}-(nx)"-+... diverges for 
all values of x except x=0 because (nx)"” —> œ as n—+oo no matter what 
the x, as long as it is different from zero. 


lim 
n> 2 


x 
al-e<! 


nor 


Theorem 3. The power series 
A, +a,xX-+a,x°+...+4,x"+... (1) 
is dominated on any interval [— p, p] that lies completely inside 
the interval of convergence. 
Interval of convergence 


-8 -p 0 p R 
interval of majorization 
Fig. 117 


Proof. It is given that p < R (Fig. 117) and therefore the num- 
ber series (with positive terms) 


la |+lalp+la lo... lanlo" (7) 
converges. But when |x|< p, the terms of the series (1) do not 
exceed, in absolute value, the corresponding terms of series (7). 
Hence, series (1) is dominated on the interval [— p, p]. 


=p p 
-R x 0 fi R 


Fig. 118 


Corollary 1. On every interval lying entirely within the interval 
of convergence, the sum of a power series is a continuous function. 
Indeed, the series on this interval is dominated, and its terms are 
continuous functions of x. Consequently, on the basis of Theorem 1, 
Sec. 4.11, the sum of this series is a continuous function. 

Corollary 2. /f the limits of integration a, B lie within the interval of 
convergence of a power series, then the integral of the sum of the series 
is equal to the sum of the integrals of the terms of the series, be- 
cause the domain of integration may be taken in the interval 
[— p, p], where the series is dominated (Fig. 118) (see Theorem 1, 
Sec. 4.12, on the possibility of term-by-term integration of a domi- 
nated series). 
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4.14 DIFFERENTIATION OF POWER SERIES 
Theorem 1. If a power series 
s(x) =a,+ax+a,x?+axtat+...ta,x"+... (1) 


has an interval of convergence (— R, R), then the series 
@ (x) =a, + 2a,x +30? +... na,x""I-+... (2) 


obtained by termwise differentiation of the series (1) has the same 
interval of convergence (— R, R); here, 


p(x)=s'(x) if |x|<R 


i.e., inside the interval of convergence the derivative of the sum 
of the power series (1) is equal to the sum of the series obtained by 
termwise differentiation of the series (1). 

Proof. We shall prove that the series (2) is dominated on any 
interval [—p, p] that lies completely within the interval of con- 
vergence. 


ee 
-R -p 0 T p ERLA 
Fig. 119 
Take a point such that p<Ẹ< R (Fig. 119). The series (1) 
converges at this point, hence lim a,&"=0; it is therefore possible 
to indicate a constant number M such that 
la| <M (n=1, 2,...) 
If |x|<p, then 


|na,x"-*|<|na,o"-?| =n |a,8"-2| T 


el. aes 


where 
a, P 
E <l 


Thus the terms of the series (2), when x|< p, are less, in abso- 
lute value, than the terms of a ‘positive number series with con- 
stant terms: 


P+ 2g +39? +... ngii...) 


But the latter series converges, as will be evident if we apply 
the d’Alembert test: 


4 ngn-1 
dim. (n— 1) q”-? 
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Hence, the series (2) is dominated on the interval [— p, p], and by 
Theorem 2, Sec. 4.12, its sum is a derivative of the sum of the 
given series on the interval [— p, pọ], i.e., 


p(x) =s' (x) ° 


Since every interior point of the interval (— R, R) may be 
included in some interval [— p, p], it follows that the series (2) 
converges at every interior point of the interval (—R, R). 

We shall prove that outside the interval (— R, R) the series (2) 
diverges. Assume that the series (2) converges when x,>R. 
Integrating it termwise in the interval (0, x,), where R < x, < xX,» 
we would find that the series (1) converges at the point x,, but 
this contradicts the hypotheses of the theorem. Thus, the interval 
(— R, R) is the interval of convergence of series (2).. And the 
theorem is proved completely. 

Series (2) may again be differentiated term by term, and this 
may be continued as many times as one pleases. We thus have 
the conclusion: 

Theorem 2. Jf a power series converges in an interval (— R, R), 
its sum is a function which has, inside the interval of convergence, 
derivatives of any order, each of which is the sum of a series re- 
sulting from term-by-term differentiation of the given series an 
appropriate number of times; here, the interval of convergence of 
each series obtained by differentiation is the same interval (— R, R) 


4.15 SERIES IN POWERS OF x—a 


Also called a power series is a functional series of the form 
a+ 4, (x—a) +a, (x—a)} +... +a, (%—a)"+... (1) 


where the constants a,, a,,...,a,,... are likewise termed coeffi- 
cients of the series. This is a power series arranged in powers of 
the binomial x—a. 

When a=0, we have a power series in powers of x, which, 
consequently, is a special case of series (1). 

To determine the region of convergence of series (1), substitute 


x—a=X 
Series (1) then takes on the form 
a,+a,X +a,X*+...+a,X"+... (2) 


we thus have a power series in powers of X. 

Let the interval — R < X < R be the interval of convergence 
of the series (2) (Fig. 120, a). It thus follows that series (1) will 
converge for values of x that satisfy the inequality — R < x—a < R 
or a—R<x<a+R. Since series (2) diverges for |X|>R, the 


19—2082 
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series (1) will diverge for |x—a|>R, that is, it will diverge 
outside the interval a~R<x<a+R (Fig. 120, b). 

And so the interval (a—R, a+ R) with centre at the point a 
will be the interval of convergence of series (1). All the properties 
of a series in powers of x inside the interval of convergence 
(—R, +R) are retained completely for a series in powers of 
x—a inside the interval of convergence (a— R, a+ R). For.example, 


-~R 0 R X 
(a) SOE 
a-R -——_a+R 
(o) + z Of =e. J 
P 120 cia 121 


after term-by-term integration of the power series (1), if the limits 
of integration.lie within the interval of convergence (a— R, a+ R), 
we get a series whose sum is equal to the corre ponding integral 
of the sum of the given series (1). In the case of termwise diffe- 
rentiation of the power series (1), for all x lying inside the inter- 
val of convergence (a—R, a+ R) we obtain a series whose sum 
is equal to the derivative of the sum of the given series (1). 


Example. Find the region of convergence of the series 
(x —2) + (x —2)?+4 (x—2)9 4... + (x—2)" +... 
Solution. Putting x—2= X, we get the series 
X+X?4 X+... HX... 


This series converges when —l < X < +1. Hence, the given series converges 
for all x that satisfy the inequality —1 < x—2 < I, that is, when 1 <x <3 
(Fig. 121). 


4.16 TAYLOR’S SERIES AND MACLAURIN’S SERIES 


In Sec. 4.6, Vol. I, it was shown that for a function f(x) that 
has all derivatives up to the (n+1)th order inclusive, Taylor’s 
formula holds in the neighbourhood of the point x=a (that is, 
in some interval containing the point x =a): 


f(x) =f (@) +=" @ 
HETE pat... + ESPE fe (a) + R, to) (1) 


where the AR remainder term R,(x) is computed from the 
formula 


(x—a)” +1 


R, = apr ft [a+ (xa), 0<0<1 
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If the function f(x) has derivatives of all orders in the neigh- 
bourhood of the point x=a, then in Taylor’s formula the number 
n may be taken as large as we please. Suppose that in the 
neighbourhood under consideration the remainder term R,, tends 
to zero as n —>» oo: 

lim R,, (x) =0 

n> n 
Then, passing to the limit in formula (1) as n— œ, we get an 
infinite series on the right which is called the Taylor series: 


F=f +227 @t+...¢ S™pr@+... 


This equation is valid only when R,(x)—+0 as n— œ. Then the 
series on the right converges and its sum is equal to the given 
function f(x). Let us prove that this is indeed the case: 

f (x) = Pa (x) + Ra (x) 


where 
P, (x) =f (a) +75 (a)+... E=! fon (a) 


Since it is given that lim R,(x)=0, we have 
f(x) = lim P, (x) 


But P,,(x) is the nth partial sum of the series (2); its limit is 
equal to the sum of the series on the right side of (2). Hence, 
(2) is true: 


Fo =Fa@ +27 @t+2"roa+...4 5" m@st... 


From the foregoing it follows that the Taylor series is a given 
function f(x) only when lim R,(x) = 0. If lim R, (x) 0, then the series 
is not the given function, although it may converge (to a different 
function). 

If in the Taylor series we put a=0, we get a special case of 
this series known as Maclaurin’s series: 


FO=FO+APO+FLEPO+...+-2 (+... @) 


If for some function we have a formally written Taylor’s 
series, then in order to prove that this series is a given function 
it is either necessary to prove that the remainder term approaches 
zero, or to be convinced in some way that this series converges 
to the given function. 

We note that for each of the elementary functions defined in 
Sec. 1.8, Vol. I, there exists an a and an R such that in the inter- 
val (a—R, a+R) it may be expanded into a Taylor’s series or 
(if a=0) into a Maclaurin’s series. 


19* 
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4.17 SERIES EXPANSION OF FUNCTIONS 


1. Expanding the function f(x) ==sinx in a Maclaurin’s series. 
In Sec. 4.7, Vol. I, we obtained the formula 


= aa x5 l PAA x?n-1 R 
sinx=x—zi tgr t. tH!) Gni t an (X) 
Since it has been proved that lim R,, (x) =0, it follows, by what was 


non 
said in the preceding section, that we get an expansion of sin x 
in a Maclaurin’s series: 
yeni 


iia ++ + (—1)"*? a (1) 
= ay by ee Ras DT 


Since the remainder term approaches zero for any x, the given 
series converges and, for its sum, has the function sinx for 
any x. 


y z 
` ld I 
\ st j 
\ Fá e 
\ Fa l 
\ z I 
\ A 1 3 1 s 
\ of SFI EL tit, 


Fig. 122 


Fig. 122 shows the graphs of the function sinx and of the 
first three partial sums of the series (1). 

This series is used to compute the values of sinx for different 
values of x. 

To illustrate, let us compute sin 10° to the fifth decimal place. 


——. 
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Since 10°= (radians) 0.174533, we have 


: o 1 1/x\3 1 /a\e Irna 
sin 10 =5-7(5) E ata 5) +... 
.Confining ourselves to the first two terms, we get the following 
approximate equation: 
ee eee ial 
18 ~ 18 6 aE) 


here, we are in error by 5, which in absolute value is less than 
the first of the suppressed terms; that is, 


1 /n\5 l Š 
ò< Ali) < 745 (0.2)8 < 4- 107° 


If each term in the expression for sins is computed to six 


decimal places, we get 
sin 7g = 0.173647 


We can be sure of the first four decimals. 
2. Expanding the function f(x)=e* in a Maclaurin’s series. 
Qn the basis of Sec. 4.7, Vol. I, we have 


2 æ n 
e=al+x+5tG+.. tot... (2) 
since it was proved that lim R,(x)=0 for any x. Hence, the 


series converges for all values of x and is the function e*. 
Substituting x=— x, in (2), we get 


7 x2 e xt 
e *=l]l—x+ġ ata (3) 


3. Expanding the function f(x)=cosx in a Maclaurin’s series. 
From Sec. 4.7, Vol. I, we have 


x? , xA x8 
cos xX = lap a art eas (4) 


for all values of x the series converges and represents the function 
cos x. 
4. Expansion, in Maclaurin’s series, of the functions 


f(x) =sinhx=" 


F(x) = cosh x= "te" 


These functions are readily expanded by subtracting and adding 
the series (2) and (3) and dividing by 2. 
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Thus, 
5 7 
sinhx=x+2424F4... (5) 


coshx=14 242424... (6) 


4.18 EULER’S FORMULA 


Up till now we have considered only series with real terms and 
have not dealt with series with complex terms. We shall not give 
the complete theory of series with complex terms, for this goes 
beyond the scope of this text. We shall consider only one important 
example in this field. 

In Chapter 7, Vol. I we defined the function e**” by the equa- 
tion 

ext '¥ = e* (cosy +isin y) 


When x=0, we get Euler’s formula: 
e¥=cosy+isiny 


If we determine the exponential function e® with imaginary 
exponent by means of formula (2), Sec. 4.17, which represents the 
function e* in the form of a power series, we will get the very 
same Euler equation. Indeed, determine e” by putting the expres- 
sion iy in place of x in equation (2), Sec. 4.17: 


, i iy)? . (iy)s iy)n 
ea 1 aS (1) 


n! 


Taking into account that i =—1, ®=—i, it=1, =i, i= —l], 
and so forth, we transform (1) to the form 


yaj t wii 
v=lt+ y-axes ta t 


Separating in this series the reals from the imaginaries, we find 
y— y3 o y* -(y yy 


The parentheses contain power series whose sums are equal to 
cosy and siny, respectively [see formulas (4) and (1) of the pre- 
ceding section]. Consequently, 


e” =cosy+isiny (2) 


Thus, we have again arrived at Euler’s formula. 
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4.19 THE BINOMIAL SERIES 


1. Let us expand the following function in a Maclaurin’s series: 


F(x) =(1+x)" 


where m is an arbitrary constant number. 

Here the evaluation of the remainder term presents certain dif- 
ficulties and sc we shall approach the series expansion of this 
function somewhat differently. 

Noting that the function f(x)= (1+ x)” satisfies the differential 
equation 


(1 +x) F (x) = mf (x) (1) 
f(0)=1 


we find a power series whose sum s(x) satisfies equation (1) and 
the condition s(0)= 1: 


s(x) = ]+a,x+a,x°+...+4a,x"+...* (2) 
Putting this series into equation (1), we get 
(1 +x) (a, + 2a,x + 3a,x?+ ... +na,x"-2-+...) 
=m(ltax+ax?+...+a,x"+...) 


Equating the coefficients of identical powers of x in different parts 
of the equation, we find 


and the condition 


a,=m, a,+2a,=ma,, ..., na,+(n+1)a,,,=ma,,... 
Whence for the coefficients of the series we get the expressions 
a,=1l, ay=m, a, = 2) ar) 

_ ag (m—2)_— m(m—1)(m—2) 

3 3 =. 9. 3 peee 

a, mml.. matn, 

1.2...n 

These are binomial coefficients. 
Putting them into formula (2), we obtain 


s(x)=14-mx +E ey, 


m(m—1). fer 


a a., (3) 


mine) 


* We took the absolute term equal to unity by virtue of the initial con- 
dition s(0)=1. 
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If m is a positive integer, then beginning with the term con- 
taining x”+1 all coefficients are equal to zero, and the series is 
converted into a polynomial. For m fractional or a negative inte- 
ger, we have an infinite series. 

Let us determine the radius of convergence of series (3): 


_m(m—1)...[m—n+]] ú _ m(m—1)...[m—n+2] 


= n n= 
Une = nl a n {n— 1)! x 

i i —1)...(m—n+1)(a—1)! 

lim +] = 1 eae eee 

neal “n ee m(m—1)...(m—n+2) a! 


= lim [PEE | x} =|] 


Thus, series (3) converges for |x| <1. 
In the interval (—1, 1), series (3) is a function s(x) that satis- 
fies the differential equation (1) and the condition 


s(0)=1 


Since the differential equation (1) and the condition s(0) = 1 
are satisfied by a unique function, it follows that the sum of the 
series (3) is identically equal to the function (1+ x)", and we 
obtain the expansion 


(l-+x)"=1+mxe4+72%— Geta De) eit? x+... (8) 


1-2-3 
For the particular case m=—1, we have 
1 
[eg pee (4) 
For m=5 we get 
Ta i soon 2 1-3 -3 1-3-5 4 r 
Vi+x=14+ 5% sat tage are te: (5) 
For m=—+ we have 
See ee o 1:3, 1-3-5 5 | L357 4 
Vinee toa” aa eae | O) 


2.Let us apply the binomial expansion to the expansion of 
other junctions. Expand the function 


f (x) = arcsin x 
in a Maclaurin’s series. Putting into equation (6) the expression —x? 
in place of x, we get 
1 


— = i 2 13 4 1-3-5 6 1-3-5...(2n—1) , 
Vi-x# large tza“ togo” Teer tee 
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By the theorem on integrating power series we have, for 
|x| < 


1: 
(at 13 x8 163.5 x? 
x5 3-5 x 
f n =arcsinx =x +5 EY aT e a 
0 


1-3-5...(2n— 1) x?n+1 
t 2.4.6...2n 2n+1 


This series converges in the interval (—1, 1). One could prove 
that the series converges for x=-+1 as well as that for these 
values the sum of the series is likewise equal to arcsinx. Then, 
setting x=1, we get a formula for ee n: 


1-3-5 1 
arcsinl=F=1+5- sta" stre zte 


4.20 EXPANSION OF THE FUNCTION In (1 -+ x) 
IN A POWER SERIES. COMPUTING LOGARITHMS 


Integrating equation (4), Sec. 4.19, from 0 to x (when |x| < 1), 
we obtain 
x 


feefoer.. .)dt 
or 
In(1+x) =r +E HI ee.) 


This equation holds true in the interval (—1, 1). 
If in this formula x is replaced by —x, then we get the series 
x? xe ox! 
In (1—x)=—x— z-z gs (2) 
which converges in the interval (—1, 1). 

Using the series (1) and (2) we can compute the logarithms of 
numbers lying between zero and two. We note, without proof, 
that for x= 1 the expansion (1) also holds true. 

We will now derive a formula for computing the natural loga- 
rithms of all integers. 

Since in the term-by-term subtraction of two convergent series 
we get a convergent series (see Sec. 4.1, Theorem 3), then by sub- 
tracting equation (2) from equation (1) term by Sm we find 


In (1+x)— 1n (1—x) = In t* =2 [+5 ae Hi 


= n+l, then x= 


Now put ;—— a ar ‘ 


For any n>0O we have 
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0<x<_1; therefore 
In t= In ne! 
—x 


1 1 1 
=2 |z Fi taap t sapt d 
whence 


In(n + 1)—Inn =2[ 


1 1 
mits toot: | (3) 
For n=l we then obtain 


1 1 1 
n2=2| 3+3 tsr +] 


To compute In2 to a given degree of accuracy ô, one has to 
compute the partial sum s,, choosing the number p of its terms 
such that the sum of the suppressed terms (that is, the error R, 
committed when replacing s by s,) is less than the admissible 
error ô. To do this, let us evaluate the error R,: 


l 4 
oe lariat era ataa pret | 


Since the numbers 2p +3, 2p+5, ... are greater than 2p+ 1, it 
follows that by replacing them by 2p+ 1 we increase each fraction. 
Therefore, 


1 1 1 
Re <2 lmt tart] 
or 


l 1 1 1 
Re <apat|aataateat-.| 
The series in the brackets is a geometric progression with ratio 


g Computing the sum of this progression we find 


l 
2 as I 
Rp < p41 Z%+1] = Qp+ 13-14 (4) 


If we now want to compute In2 to, for example, nine decimal 
places, we must choose p such that R, < 0.000000001. This can be 
done by selecting p so that the right side of inequality (4) is less 
than 0.000000001. By dirett choice we find that it is sufficient 
to take p= 8. To nine-place accuracy we have 

l | 1 1 1 1 

n2xs=2|3+zs tsr try toy tmm 
l l 
tiga tgz] = 0.693147180 


Thus, In 2 =0.693147180, correct to nine places. 
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Assuming n==2 in formula (3), we obtain 


In3=In2+2 [$ +35 +g +- | = 1.098612288, and so forth. 
In this way we obtain the natural logarithms of any integer. 
To get the common logarithms of numbers, use the following 

relation (see Sec. 2.8, Vol. I): 

log N= MIinN 
where M = 0.434294. Then, for example, we get 
log 2 = 0.434294 x 0.693147 = 0.30103 


4.21 SERIES EVALUATION OF DEFINITE INTEGRALS 


In Chapters 10 and 11 (Vol. I) it was noted that there exist 
definite integrals, which, as functions of the upper limit, are not 
expressible in terms of elementary functions in closed form. It is 
sometimes convenient to compute such integrals by means of series. 

Let us consider several examples. 

1. Let it be required to compute the integral 

a 

f e-** dx 

0 
Here, the antiderivative of e-*" is not an elementary function. To 
evaluate this integral we expand the integrand in a series, replac- 
ing x by —x? in the expansion of e* [see formula (2), Sec. 4.17]: 


E x2 x4 x8 n xt" 


Integrating both sides of this equation from 0 to a, we obtain 


a 
-# dy (% 4 2 i 
fe dx=(4 131 Os arte) 


0 


a a? a a’ 
[ine tas aig be 
Using this equation, we can calculate the given integral to any 


degree of accuracy for any a. 
2. It is required to evaluate the integral 


a . 
ie 
x 
Expand the integrand in a series: from the equation 


` e x8 x? 
sinx=x— z t3 at ute 
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we get 


the latter series converges for all Jales of x. Integrating term by 
term, we obtain 


a 
Gia ae ter ee 


The sum of the series is readily computed to any degree of accu- 
racy for any a. 
3. Evaluate the elliptic integral 


oe ala 


VIi—Fsintgdp (k< 1) 
Expand the integrand in a binomial series, putting m=, 
x = —k*sin?@ [see formula (5), Sec. 4.19]: 


— 11 113 
V 1—? sin? p p=1—4 k sintp— y Fk sin'p—4 7 = ksing... 


This series converges for all values of ọ and admits term-by-term 
integration because it is dominated on any interval. Therefore, 


9 9 
(VIZES dt = g— t {sine tdrt Lf sin‘ ¢ dt 
0 ð 0 
ae 
Ze \sinveat—... 
6 
The integrals on the right are computed in elementary fashion. 
For ọ = > we have 


..(2n—1) n 


a Gap Tim T 


esa 


(see Sec. 11.6, Vol. I) and, hence, 


= 


f V 1—k"sin? p dp = > z[1—(7) #— (za) s (rr) e] 


1 
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4.22 INTEGRATING DIFFERENTIAL EQUATIONS 
BY MEANS OF SERIES 


If the integration of a differential equation does not reduce to 
quadratures, one resorts to approximate ‘methods of integrating 
the equation. One of these methods is representing the equation 
as a Taylor’s series; the sum of a finite number of terms of this 
series will be approximately equal to the desired particular 
solution. 

To take an example, let it be required to find the solution of 
a second-order differential equation, 


y" =F (x, y, y’) (1) 
that satisfies the initial conditions 
(Y)x=x, = Yo» (Y')x=x = Yo (2) 


Suppose that the solution y= f(x) exists and may be given in 
the form of a Taylor’s series (we will not discuss the conditians 
under which this occurs): 

(x — x0)? 


y= f) = f A HETE (+A T H 3) 


We have to find f (x,), F (Xa), F (xo), .--, i.e., the values of the 
derivatives of the particular solution when x-=x,. But this can 
be done by means of equation (1) and conditions (2). 

Indeed, from conditions (2) it follows that 

f (xo) = fo F (xo) =h 
from equation (1) we have 
F (xo) = (Y)x=x, =F (x, Yo Yo) 
Differentiating both sides of (1) with respect to x, we get 


y” =F;(x, y, y')+ Fi lx, y, y’) y +Fy (x, y, yy (4) 
and substituting the value x=x, into the right side, we find 


F” (xo) = (Y" xan 


Differentiating the relationship (4) once again, we find 
PY (x0) =(y'¥ eax, 
and so on. 


We put these values of the derivatives into (3). For those va- 
lues of x for which this series converges, this series represents the 
solution of the equation. 

Example 1. Find the solution of the equation 

y =y? 
which satisfies the initial conditions 
(Y)x=0= l, (y')x=9=0 
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Solution. We have i 
FO=y=l, F (0)=yo=0 
From the given equation we find (y”)x=o= f” (0) =0; further, 
y” = —y'x? — Ixy, (y )eco =f" (0) =0, 
yW = —y"x8 — Axy’—2y, (YY) gap = —2 
and, generally, differentiating k times both sides of the equation by the Leib- 
niz formula, we find (Sec. 3.22, Vol. I) 
ysk +2) = —ytk)x? — 2kxyk -D — k (k— 1) yk- 
Putting x=0, we have 
y? = —k (k— 1) y” 
or, setting k+2=n, 
yo” =— (n—3) (n—2) yy 
Whence 
ylV =—1.2, y® = —5.6y!V = (—1)? (1-2) (5-6) 
yo”? = —9- 10y” = (—1)3 (1-2) (5-6) (9-10) 


. . beoeo obl ool‘o‘’l l‘ ‘‘ 


r 


In addition, 

yo =0, yo’ =0, ..., y0 =o, 
..., yt) 0, .. 
ys =0, ySP=0, ..., yM*t?=0, ... 


Thus, only those derivatives whose order is a multiple of four do not 
become zero. 

Putting the values of the derivatives that we have found into a Maclaurin 
series, we get the solution of the equation 


x? x8 x2 
y=l -7 l. 2+ 3 ( +2) (5-6) —+5y (1-2) (5-6) (9-10)-+... 


4k 
+(— De (1-2) (5-6). . .[(4Ł—3) (4k—2)] +... 


By means of d’Alembert’s test we can verify that this series converges for all 
values of x; hence, it is the solution of the equation. 


If the equation is linear, it is more convenient to seek the 
coefficients of expansion of the particular solution by the method 
of undetermined coefficients. To do this, we put the series 


y=, +a, x+ ax + ...+a,x"+... 


into the differential equation and equate the coefficients of identi- 
cal powers of x on different sides of the equation. 


Example 2. Find the solution of the equation 
y" = 2xy' + 4y 
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that satisfies the initial conditions 


(y)x=0 = 0, (9')x=0 =1 
Solution. We set 
y = Ag+ a,x + ax? + agx8+...fa,xt+... 
On the basis of the initial conditions we find 
a = 0, ay= 1 
Hence, 
y=x+a_x?4-agx84+-... ta,x8 +... 
y’ =1-+4 2a,x + 3agx2+ ...-+na,x"-1+... 
y" = 2a, +3-2agx-+ ... +n(n—l)ax" 2+... 
Putting these expressions into the given equation and equating the coefficients 
of identical powers of x, we obtain 
2a, =0, whence a =0 
3-2a3=2+4, whence as = 1 
4.3a, = 4a, + 4a, whence a,=0 


oe © s osoon o 


n(n— l)a =(n—?2)2an-3+4an-2, whence a,= 2an-s 


n—1 
Consequently, 
1 
O21 1 Aigi ol 
a= gSa A grt, OR ay e 
1 
2 @—m 1 
Agrt+i= ok = hh’ , 
a,=0; ag=0, ..., Qak=Q, ... 


Substituting the coefficients which we have found, we get the desired solution: 
x2kt+1 


yore ghey gee A 


The series thus obtained converges for all values of x. 

It will be noted that this particular solution may be expressed in terms of 
elementary functions: taking x outside the brackets we get (inside the brackets) 
an expansion of the function e**. Hence, 


y = xex? 


4.23 BESSEL’S EQUATION 


Bessel’s equation is a differential equation of the form 
xy" + xy’ +(x*—p*)y=0 (p= const) (1) 
The solution of this equation (and also of certain other equations 


with variable coefficients) should be sought not in the form of a 
power series, but in the form of a product of some power of x by 
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a power series: 
W 
y=x' D apx (2) 
k=0 
The coefficient a, may be considered nonzero due to the indefi- 


niteness of the exponent r. 
We rewrite the expression (2) in the form 


© 
y= $ art 
k=0 
and find its derivatives: 


y= D (rt a) ayers 
k=0 


y= 2 (r-+k) (r+ R—1) agx'te-? 


Put these expressions into equation (1): 
vy (r+k)(r +kR—1) a,xitk-? 
=0 


+a D (rR) age ttt + tp) È aye? =0 
= =0 
Equating to zero the coefficients of x to the powers r, r+ 1, 
r+2, ..., r+, we get a system of equations: 
[r (r—1)+r—p?]a,=0 or (r?— p*)a,=0 
(r+) r+(r+1)—p*]a,=0 or (r+ 1)*—p*] a, =0 
[(r-+2) (r+ 1)+(r+2)—p*] a,+a,=O0or [(r + 2)’—p*] a,+a,=0 


[(r +) (+k) + (r+) —p*] dy + a4, =0 or 
[C +k) — p] a, + ap- =0 


e EE © © © © e © © © © © © © © © © © © © © © © © 2 


Let us consider the equation 
[(r +k) —p?] ay + ap-, = 0 (3’) 
It may be rewritten as follows: 
[ir-+k—p) (r-+&+ p)] ay + a4-.=0 
It is given that a, 0; hence, 
r—p=0 
therefore, 7, =p or r, =— p. 
Let us first consider the solution for r =p>0., 
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From the system of equations (3) we determine all the coeffi- 
cients a,, a,, ... in succession; a, remains arbitrary. For instance, 
put a,=1. Then 
A es SS g 
. k (2p +k) 


Assigning various values to k, we find 


a,=0, a,=0 and, generally, a,,,,,=0, | 
1 1 
a= — Fp’? MIT FAFA (4) 
1 
aay =(— 1)** Se pe LD ed y ioris | 
-4.6...2v (2p +2) (2p + 4)...(2p + 2v) 
Putting the coefficients found into (2), we obtain 
x? 
Se [1- 2 p+3) oF + 34 p +o) Opts) 
rene Tawra (5) 


All the coefficients asy will be determined, since for every k the 
coefficient of a, in (3), 
(+4) p 


will be different from zero. 

Thus, y, is a particular solution of equation (1). 

Let us further establish the conditions under which all the coef- 
ficients a, will be determined for the second root r, = — p as well. 
This will occur if for any even integral positive k the following 
inequalities are fulfilled: 


(ra +k) — p #0 (6) 
or 
le +k#Æp 
But p=r,; hence, 
r,tkAr, 
Thus, condition (6) is in this case equivalent to the following 
rr, ek 
where k is a positive even integer. But 
Mp, h= — Pp 
hence 
r,—T, = 2p 


Thus, if p is not equal to an integer, it is possible to write a 
second particular solution that is obtained from expression (5) by 
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substituting —p for p: 


x2 


Y= xP [1 ESTHET 


sre ea nrat | (65°) 


The power series (5) and (5’) converge for all values of x; this 
is readily found by d’Alembert’s test. It is likewise obvious that y, 
and y, are. linearly independent.* 

The solution y, multiplied by a certain constant is called a 
Bessel function of the first kind of order p and is designated by 
the symbol J,. The solution y, is denoted by the symbol J_,. 

Thus, for p not equal to an integer, the general solution of 
equation (1) has the form 


y =C, Jp +C -p 
For instance, when p=5 the series (5) will have the form 


1 
Paa x2 xi x8 5 
x? 1At Riess | 
1 x 
=y [ati at] 


This solution multiplied by the constant factor y? is called 
Bessel’s function J, ; we note that the brackets contain a series 


2 
whose sum is equal to sinx. Hence, 
EE 
Jı (x)= — sinx 
7 nx 


In exactly the same way, using formula (5’), we obtain 


2 
J ı (x)= — cosx 
-7 1A 


* The linear independence of functions is verified as follows. Consider the 
relation 
= x + x 
E OE ee 
Ht Pie 
Opty 2. DIE 


This relation is not constant, since it approaches infinity as x — 0. Hence the 
functions y, and y are linearly independent. 
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The complete integral of (1) for p=t is 
y=CJa (x) HC v1 (x) 
2 2 


Now let p be an integer which we shall denote by n(n =Œ 0). 
The solution (5) will in this case be meaningful. and is the first 
particular solution of (1). 

But the solution (5’) will not be meaningful because one of the 
factors of the denominator will become zero upon expansion. 

For positive integral p==n the Bessel function J, is determined 


by th 
n=0 we multiply T 1): 


x$ 


no = sy [I aaa 


—~ 9.4.6 nF 2) reer a Fat: 
or 


E a aan ($) (7) 


It may be shown that the second particular solution should in 
this case be sought in the form 


K, (x)= J, (x) Inx + x7" 2 b,x* 


Putting this expression into (1), we determine the coefficients b,. 

The function K, (x), with the coefficients thus determined, mul- 
tiplied by a certain constant is called Bessel’s function of the second 
kind of order n. 

This is the second solution of (1), which, together with the first 
one, form a linearly independent system. 

The general integral will be of the form 


y=C,J, (x) +C,K,, (x) (8) 
We note that 
lim K, (x)= œ 
x70 


Hence, if we want to consider the final solutions for x =0, then 
we must put C,=0 into formula (8). 


Example. Find the solution of Bessel’s equation, for p=0, 
n 1 t 
y +7” +y=0 
20 * 


308 Ch. 4 Series 


that satisfies the initial conditions: for x=0, 
y=2, y’=0 
Solution. From (7) we find one particular solution: 


œ% 


no- È BE (Eilian “ai BY 


Using this solution, we can write a solution that satisfies the given initial 
conditions, namely: 
y = 2S (x) 


Note. If we had to find the general integral of this given equation we would 
seek the second particular solution in the form 


Ko (x)= Jo (x) Inx+ J) bpxk 
k=0 


Without giving all the computations, we indicate that the second particular 
solution, which we denote by Ko (x), is of the form 


Kota domes Baal S (tame. 


This function multiplied by some constant factor is called Bessel’s function of 
the second kind of order zero. 


4.24 SERIES WITH COMPLEX TERMS 


Let us consider a sequence of complex numbers: 


Ži Rey Ae Zany Mk 
where 
2,=a,+ib, (n=1, 2, ...) 


Definition 1. A complex number z,=a + ib is the limit of a se- 
quence of complex numbers z,=a,-+ib, if 


lim |z,—2z,|=0 (1) 
n—> a 
Let us write condition (1) in expanded form: 


Zar — Z = (an + ib,) —(a F ib) = (a,—4) +i (ba —5) 
lim |z ,— z, |= lim V (a, —a) + (6,—6)?=0 (2) 
From (2) it follows that condition (1) will hold provided the 
following conditions are valid: 
lim a, =a, lim 6, =b (3) 


n> œo n> o 
Let us form a series of complex numbers 
w twt... Hrt... (4) 
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where 
W, =Uu,+tiv, (n=1, 2, ...) 
We consider a sum of n terms of the sesies (4), which we denote 
by s,: 
S,=W,+0,+...+8, (5) 
where s, is a complex number: 


sal Sates) éj 


Definition 2. If the limit 
lim s,=s=A+iB 


nwo 
exists, then series (4) is termed a convergent series and s is called 
the sum of the series: 


= 2 my =A+iB (7) 
From condition (6), on the basis of (3), follow the equations 
A= lim 2 üp, = lim È Up (8) 
n—> œ k=l n> o 


If there is no lims,, then series (4) is a divergent series. 

An effective theorem for testing the convergence of series (4) is 
the following. 

Theorem 1. /f a series made up of the absolute values (moduli) 
of the terms of series (4) converges, 


ja, |-+|w,[+...+|o,|+..., where (w| =V uF (9) 


then series (4) converges as well. 
Proof. From the convergence of series (9) and from the conditions 


lu | SV F= wnh [on | <V uH = lw] 
follow equations (8) (on the basis of the appropriate theorem on 
the absolute convergence of series with real terms) and, hence, 
equation (7). 
This theorem enables us, when testing the convergence of a series 
with complex terms, to apply all the sufficient criteria of conver- 
gence of series with positive terms. 


4.25 POWER SERIES IN A COMPLEX VARIABLE 


We now consider power series with complex terms. 
Definition 1. A series 
ETE Aa + A a +... 4+¢,27-+...- (1) 
where z=x-+iy is a complex variable, x and y are real numbers, 
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and c, are constant complex or real numbers, is called a power 
series in a complex variable. The theory of complex power series is 
similar to the theory of power series with real terms. 

Definition 2. The collection of values of z in the complex plane 
for which the series (1) converges is called the domain of conver- 
gence of the power series (1) (for each concrete value of z, the 
series (1) becomes a numerical series with complex terms of type (4), 
See. 4.24). 

Definition 3. The series (1) is absolutely convergent if the se- 
ries composed of the moduli of the terms of (1) converges: 


[eo|+]e,2|+]e27| +... +e |+... (2) 


We give without proof the following theorem. 

Theorem 1. The domain of convergence of-a power series with 
complex terms (1) is a circle in the complex plane with centre at 
the origin. This circle is called the circle of convergence. The series 
(1) converges absolutely at points lying inside the circle of convergence. 

The radius R of the circle of convergence is termed the radius 
of convergence of the power series. If R is the radius of conver- 
gence of the power series (1), then we write that the series con- 
verges in the domain 

|z| < R 


(The question of the convergence of the series at the boundary 
points |z|= R requires a supplementary investigation; this is si- 
milar to the problem of the convergence of a power series in a 
real variable at the end points of an interval.) Note that the ra- 
dius R of convergence can take on any value from R=0 to R =œ 
depending on the nature of the coefficients c,. In the former case, 
the seriés converges only at the point z=0, in the latter, it con- 
verges for any value of z. 

We write the equation 


f(z)=c,+ce,2+c,27+...+¢,z"+... (3) 


If z assumes distinct values within the circle of convergence, the 
function f(z) will assume distinct values. Thus, every power series 
in a complex variable defines an appropriate function of the com- 
plex variable within the circle of convergence. This function is 
called an analytic function of a complex variable The following 
are some examples of functions of a complex variable defined by 
power series in a complex variable. 


” z2 z zn 
le =142454+5+-..4+54-.. (4) 


This is the exponential function of a complex variable. If y=0, 
then formula (4) becomes formula (2), Sec. 4.17. If x=0, then we 
get equation (1), Sec. 4.18. 
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A aera E <p 
2. sinz=z—-_Z+y—-7Wt+-:- (5) 
This is the sine of a complex variable. For y =Q, formula (5) turns 
into formula (1) of Sec. 4.17. 
2 4 6 
3. cosz=1—5 4+ 5—-F +... (6) 


This is the cosine of a complex variable. If in formula (4) we put 
(iz) in place of z on the right and on the left, then (like what 
was done in Sec. 4.18) we get 

ei? —cosz+isinz (7) 


This is Euler’s formula for a complex z. lf z is a real number, 
then this formula coincides with formula (2) of Sec. 4.18. 


4. sinh z=2+245 4... (8) 
5. coshz=1424242 9 
. cosh z = tytateat::: (9) 


These last two formulas are similar to formulas (5) and (6) of 
Sec. 4.17 and coincide with the latter when z= x is a real number. 

By (4), (5), (6), (8), and (9) and via addition, subtraction of 
the series and replacement of z by (iz), we get the following equa- 
tions: 


e? = cosh z + sinh z, (10) 
e-? = cosh z— sinh z, (11) 
ez+e-2 : ez—e-z 

cosh z= —5—, sinhz=—;—, (12) 
cos iz =t, sin i= (13) 


Note that the series (4), (5), (6), (8), (9) converge for all values 
of z. This is clearly seen on the basis of Theorem | and of Sec. 
4.24. As in the case of power series of a real variable, we can 
consider series of a complex variable in powers of (z—z,), where z, 
is a complex number, c, are complex or real constants 


Cy +C, (2—2 9) +, (2—2)? +... +0,(2—2,)" +... (14) 


The series (14) is reduced to (1) by the substitution z—z, = 2*. 
All the properties and theorems that are valid for series of type 
(1) carry over to series of type (14), only the centre of the circle 
of convergence of (14) lies at point z, instead of at the origin. 

If R is the radius of convergence of series (14), then we write: 
the series converges in the domain 


|z—z|<R 
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4.26. THE SOLUTION OF FIRST-ORDER DIFFERENTIAL 
EQUATIONS BY THE METHOD OF SUCCESSIVE 
APPROXIMATIONS (METHOD OF ITERATION) 


In Secs. 1.32, 1.33, and 1.34 we considered the approximate 
integration of differential equations and systems of differential 
equations by difference methods. Here we will consider a different 
method of approximate integration of a differential equation. It 
will be noted that this is at the same time proof of the theorem 
of the existence of a solution of a differential equation (see Sec. 1.2). 
We will need the theory of series in this case. 

Let it be required to find the solution to the differential equation 


d 
H= 9) (1) 
that satisfies the initial condition 
Y =Y, for x= x, (2) 


Integrating the terms of equation (1) from x, to x and taking into 
account that yl,-x,=Y), we get 


x 


y= | f(x, ydx+y (3) 


Xo 


In this equation, the desired function y is under the integral sign 
and so the equation is called an integral equation. 

The function y= y(x) which satisfies (1) and the initial condi- 
tions (2) satisfies equation (3). It is clear that the function y= y (x) 
which satisfies (3). satisfies equation (1) and the initial conditions (2). 

Let us first consider a method of obtaining approximate solutions 
to equation (1) for the initial conditions (2). 

We will take y, for the zeroth approximation of the solution. 
Substituting y, into the integrand on the right of (3) in place of y, 
we get 

x 
n= fF y)dx ty (4) 


Xo 


This is the first approximation of the differential equation (1) 
that satisfies the initial conditions (2). 

Substituting the first approximation y,(x) into the integrand 
in (3), we get 


nid= Vfl. wW]det+y, (5) 
Xe 
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This is the second approximation. We continue the process: 


x 


ya (9) = | FL Ya (0) dt + Yo 


Sire a eee ad 3a a 
n(x) = È FLX Yn- ()] de + yp, 


Xo 


. >o o o s o o > è è è è ù s‘ 


We will indicate below what approximation is to be taken so 
as to satisfy our requirements of accuracy. 


Example. Approximate the equation y’=x«-+y? which satisfies the initial 
conditions 
Y= l for x=0 


Solution. By formula (4) we have 
x 


n=f (x+ Ddr+i=% r+ 
0 


oe [e+(Ste41) ating ePaet tasted 
0 


and so forth. 


4.27. PROOF OF THE EXISTENCE OF A SOLUTION 
OF A DIFFERENTIAL EQUATION. 
ERROR ESTIMATION IN APPROXIMATE SOLUTIONS 


We prove the following theorem. 
Theorem. Given the differential equation 


HF (x, y) (1) 
and the initial conditions 
Y=Y for X=% (2) 
Let f(x, y) and f(x, y) be continuous in a closed domain D: 
D {x—a <x <4 +4, Y —b <y <y, +} (Fig. 123) (3) 
Then, in some interval 
X—lL<x<xtl (4) 


there exists a solution to equation (1) which satisfies the initial 
conditions (2); and the solution is unique. The number | will be 
defined below. 
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Proof. Note that from the fact that f(x, y) and f,(x, y) are 
continuous in a closed domain D it follows that there exist cons- 
tants M>0O and N >O such that for all points of the domain 
the following relations hold: 


[F WI<M, (5) 
Ifo (% WI<N (6) 
(This property is similar to the property indicated in Sec. 2.10, 
Vol. I.) The number / in (4) is the 


smaller of the numbers a and a 


(oht b) 


l= min (a, m) (7) 


Fig. 193 Let us apply the Lagrange theorem 
8- to the function f(x, y) for two arbit- 
rary points A, (x, y,) and A,(x, y,) belonging to D: 


F(x, Y) — F(x, y) = fi (% n) (Y2— 9) 


where y, << 4», hence, |f; (x, n)|<<N. Thus, for any two points 
the following inequality is true:* 


|f (x, Y:)— f (x, YAI SN| y — y] (8) 

Let us return to equation (4) of Sec. 4.26. From this equation, 
taking into account (5), (4), (7), we get 
x 
| F(x, yo) dx 
Xo 
Thus, the function y=y,(x) defined by (4), Sec. 4.26, on the 
interval (4) does not go outside domain D 

Now we take up equation (5) of Sec. 4.26. The arguments of 
the function f [x, y,(x)] do not leave D. Hence, we can write 


\ Fle y, (dx 


Xo 


x 


<|Mdx=M|x—x,|<MI<b (9) 


Xo 


14. —Y |= 


| Y¥2—Yol = <M|x—x,|<Ml<b (10) 


* Note that if for some function F (y) the following condition is satisfied: 
|F (2) —F (y) |< K | yo — y| 


where y and y, are any points in the domain and K is a constant, then this 
condition is called the Lipschitz condition. Thus, having established the rela- 
tion (8), we demonstrated that if a function f(x, y) has a derivative 
bounded in some domain, then it satisfies the Lipschitz condition in that 
domain. The converse may not prove to be true. 
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By the method of complete induction we can prove that for 


arbitrary n 
| Yn— Y| <b e (11) 


if x lies in the interval (4). 
We will now prove that there exists a limit 


Tim gn (x) =y (x) (12) 


and the function y(x) satisfies the differential equation (1) and 
the initial conditions (2). To prove this, consider the series 


Yo + (Yı — Y.) + (Y.— 41) + E + (Yn-1—Yn-2) + (Yn—Yn-1) + eae (13) 


with general term u,=y,—y,-, with u,=y,. The sum of n+1 
terms of this series is clearly equal to 


Sri = -$ u; i=Yn (14) 


Let us estimate the terms of series (13) in absolute value: 


lu — 4% |= <M|x—x,| (15) 


\ F(x, y)dx 


On the basis of (4), (5), Sec. 4.26, and (6) we find 


| f(x, m) Ys — y) ax 


Xo 


f [F (x, y) —f (x, Y)] dx 


Xo 


[Y— y |= 


<+N§M|x—x,| dx =N {xxl 
Xo 


(the plus sign is taken if x,< x, and the minus sign if x, > x). 
Thus 


1¥2— |< MN | x— x) (16) 


Similarly, taking into account (16), 


(fF, y—F x, y)] dx 


Xo 


= ie (x, Na) (Ya— 4Y) dx 


Xo 


|¥s—Y_|= 


IN 


+N | Y ex, Pde MM xx, (17) 


Xa 
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Continuing in the same fashion, we have 
nal 
|Yn—Yn-1 |< MM] x—x, |" (18) 
Thus, for the interval |x—x,|<J/ the series (13) of functions is 


dominated. The corresponding numerical series with positive terms, 
which exceed in absolute value the corresponding terms of series (13), is 


NI? N2413 Nn-1n 
y+Mi+Ma+M—a-+...+M——-+.-- (19) 
with general term v, = MZE, This series converges, as may 
readily be seen by applying d’Alembert’s test: 
Nu-l[a 
i Un _ li nl lim Nt _ 
Peale mea So ak eee O 


(n=1)! 
Thus, the series (13) is dominated and hence converges. Since its 
terms are continuous functions, it converges to a continuous func- 
tion y (x). Thus 

lims,_, = lim y, = y (x) (20) 

n> n>n 
where y(x) is a continuous function. This function satisfies the 
initial condition since for all n 

Yn (xo) = Y 

We will prove that the function y(x) thus obtained satisfies equa- 
tion (1). We again write down the last equation of (6), Sec. 4.26: 


x 


Yn=Yo+S F Yai) de (21) 
We will prove that 7 
lim | Fle Ya- ()de= J F(x, y)dx (22) 


where y(x) is defined by equation (20). 
First note the following. Since the series (13) is dominated, it 
follows from (20) that for any e >0 there is an n such that 


Having regard for (23) over the entire interval (4), we can write 


(Fæ, gdx—S Fi yddel< + SIF, W—Fle, Yn) [de 


x 
< + Í| Nly—y,|dx<Ne|x—x,| 
Xo 
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But lime=0. Hence 


n>n 
x 


lim | È f(x, y)dx— § f(x, m)dx|=0 


Xo 


From this equation follows equation (22). 
Now passing to the limit in both members of (21) as n— œ, 
we find that y(x), defined by (20), satisfies the equation 


x 


yY=y+ | f(x, y)dx (24) 


Xo 


From this it follows, as was pointed out above, that the func- 
tion y(x) thus found satisfies the differential equation (1) and the 
initial conditions (2). 

Note 1. Using other methods of proof it is possible to assert 
that there exists a solution of equation (1) that satisfies the condi- 
tions (2) if the function f(x, y) is continuous in a domain D 
(Peano’s theorem). 

Note 2. Using a device similar to the one employed to obtain 
relation (18), we can demonstrate that the error resulting from 
replacing the solution y(x) by its nth approximation y, is given 
by the formula 
MN’ [n+1 


Example. Let us apply this estimate with respect to the fifth approximation 
Ys to the solution of the equation 


y=rtry 
given the initial conditions ys=1 when x=0. 
Suppose the domain D is 
D{—12—xq 1/2, —1&y<!} 
that is, a=1/2, b=1. Then M=3/2, N=2. We then determine 


I=mi b\cmn(L, “es poe 
=min| a, | J=minj >, 3)=9 


By formula (25) we get 
eae (z) 
2 2 1 
|y—ys < — r = 


N°M 
ly—Inl<SGppl*—* < (25) 


Note that the estimate (25) is rather rough. In the case at hand, we could show 
by other methods that the error is tens of times less. 
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4.28 THE UNIQUENESS THEOREM OF THE SOLUTION 
OF A DIFFERENTIAL EQUATION 


We will prove the following theorem. 
Theorem. /f a function f(x, y) is continuous and has a continuous 


derivative x (defined in Sec. 4.27) in a domain D then the so- 
lution of the differential equation 


=f (x, y) (1) 
is unique for the initial conditions 
y=y, when x=% (2) 
That is, through the point (x,, y,) there passes a unique integral 
curve of equation (1). 
Proof. Assume there are two solutions to equation (1) satisfying 
the conditions (2), that is, two curves emanating from the point 


A (Xos Yo):y (x) and z(x). Consequently, both functions satisfy equa- 
tion (24) of Sec. 4.27: 


pant § Fe y)dx,  2=y,+ (ho, 2) =dx 


Xo 


Consider the difference 
gy (x)—2(x) = | [fæ y) — tl, a] ax (3) 


Transform the difference in the integrand by Lagrange’s formula 
taking into account the inequality (6) of Sec. 4.27: 


ð > 
F(x, W—F (x, = FED ya) (4) 
From this equation we get 


| f (x, y)—F (x, z2)|<N|y-z| (5) 
On the basis of (3), with regard for (5), we can write the inequality 


|y—z|= fa (y—2)de| < | ly —alas 6) 


Let us consider a dane of x such that |x—x,| <. For the sake 


of definiteness, we assume that x, <x; for the case of x < x, the 
proof is analogous. 


Suppose, on the interval x—x, < ue | y— z| assumes a maximum 
value for x=x* and let it be equal to 4. Then inequality (6) as- 
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sumes, for the point x*, the form 


* 
x 


KN È Ade =NA(x*—x,) NAG <A 
Xo 
or 
KER 


With the assumption that there exist two distinct solutions we 
arrived at a contradiction. Hence, the solution is unique. 

Note 1. It may be demonstrated that the solution 
is unique for less strict restrictions on the function 
f(x, y). See, for example, I. G. Petrovsky’s “Lec- 
tures on the Theory of Ordinary Differential Equa- 
tions”. 

Note 2. If a function f(x, y) has an unbounded 
partial derivative in the domain, then there may be 
several solutions satisfying the equation (1) and the initial condi- 
tions (2). 

Indeed, consider the equation 


y =3x Vy (7) 


Fig: 124 


with initial conditions 
y=0 for x=0 (8) 
of 


Here 5g = XY — œ as y — 0. In this case there are two solutions 
to equation (7) that satisfy the initial conditions (8): 


y=0, y=% 


Direct substitution of the functions into the equation convinces 
us that they are solutions of (7). Two integral curves pass through 
the coordinate origin (Fig. 124). 
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Write the first few terms of the series on the basis of the given general term: 
(n!) 
3. = 


n 
n= Gni 4. ua=(—1)i HŽ. 


2. Un= nk 


eed J 
sen Tinh’ n+l" 
5. Un = V e+ 1— Vert, 


Test the following series for convergence: 


l 2 , 3 n 
6. yta tat ton ... . Ans. Converges. 


1 l 1 l A 
7. yno va in Tym ~ . Ans. Diverges. 
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8. 24+ 5 S+5 +.. ae A . Ans. Diverges. 


9. TRTE I ge +y . . Ans. Diverges. 
gh Ss ae 
10. $+(F) +(+) ae +... . Ans. Converges, 
11. s4et+ptat mite . Ans. Diverges. 
12. qd t yt trate . Ans. Converges. 


Test for convergence the following series with given general terms: 


1 
V nè 


Ans. Diverges. 


13. un=-5 . Ans. Converges. 14. u, = . Ans. Diverges. 15. u, = 


2 
in 1° 
l+n 
3-H n2 `’ 


Ans. Converges. 18. un -1 = a 


Ans. Diverges. 16. u,= 
ae ee . 

17. un = BL Int . Ans. Diverges. 19. Prove 

the inequality 


HEHEH ths nat > p+y+. ton: 


20. Is the Y R ees to the series 
1 


1 1 
—— 4H ose tt eh eS oe te? 
V2-1 V a ma V A +y n—1 Vy ait 

Ans. It is not applicable because the terms of the series do not decrease mo- 
notonically in absolute value. The series diverges. 

How many first terms must be taken in the series so that their sum should 
not ‘ies ae saa ae 10-6 from the ae of the corresponding series: 


21. 77 whe Pe HOI gee . Ans. n= 20. 


1 1 
22. ee ee . Ans. n= 108. 


1 1 1 1 1 
23. a gtp grt +i ast... . Ans. n= 108, 


l 1 l 1 1 
24. z-ga tzaa Daag tC ayt . Ans. n=10. 


Find out aie: of 5 e series ee absolutely: 


J 
25. a aigt. w Ips Ga pt . Ans. Converges 
l l 1l 
absolutely. 26. 5-7: ety 5 at cate a oe Ans. Con- 
verges sbeolutely: 
1 1 l z 
27. mamata mEt ma . Ans. Converges conditio- 


nally. 28. sites teat. -+(—-l)" 3 wate. .. Ans. Converges 


Va Vya 


4 
conditionally. 
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Find the sum of the series: 


1 1 1 1 
2. rza tzat tether As T 
For what values of x do the following series converge: 


x , x2 a xn xt, x8 
80. yty te Hate + Ans, —2<2<2 3 star 


4 
Ke tI pe Ans. Neel. 82. 3rH3irtt 3 
1 100x , 10 000x?. , 1000000x? 
2 yn? pan eect ob eraa OPN peter 
pans +.... Ans. |x| < 7° 33. 1+ Tat T.35 + 1.3.5.7 Easa 
ns. —~% <x <0, 


34. sin z+2sin $ 4sin $4... +2sin = 


geese Ans. —œ <x < œ. 


35. . Ans. —l&x < l.. 


pan et Wea ees Fe Ge = : 
14V 24+V2 5 nt Van 
36. Paa E tet... . Ans. —œ <x < œ. 


37. PENE N . Ans. —e < x < e. 


23 (1-2.3) (n1)? 
38. x+ * Her At- ta xng... . Ans. —4 <x < 4. 
39. Find the sum of the series x+- 2x? -+ ... nx” +... (|x| <1). Ans. Tos 


_ Determine which of the following series are dominated on the indicated 
intervals: 


40. 14-242 < 0 1). Ans. Dominated z 
. tHatat tat. <=x<1). Ans. Dominated. 41. 1+7 + 


x2, x8 x" 2 sinx , sin 2x 
tata tT oi FaF ... Ox 1). Ans. Not dominated. 42. = ta t 


+ a+ as += +... [0, 27]. Ans. Dominated. 


Expanding Functions in Series 


43. Expand wae in powers of x and determine the interval of convergence. 


Ans. The series Fony for —10 < x < W, i i E 

i Expand E p of (* ~ +) . Ans. Vi _ va (* = ł)- 
Siya (x-4) tya (==4) Picks 

45. Expand e-* in powers of x. Ans. I—x+ 9-3: E 

46. Expand e* in powers of (x—2). Ans. &- e (x—2) +o (x — 2)? 


e 
+e D+.. 2 
47. Expand x8—2x?+4-5x—7 in powers of (x—1). Ans. —3-+4(x—I 
+ (x—1)?+(x—1)8. i i TA Sj 
48. Expand the polynomial x10- 2x9—3x7—6x$+ 3x!+6x83—x—2 in a 
Taylor’s series in powers of (x—1); check to see that this polynomial has the 


21—2082 
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number | for a triple root. Ans. f (x) =81 em Eo e aano (x—1)5+ 
+ 351 (x — 1)® -+ 189 (x — 1)? +63 (x — 1)8+ 12 (x— 1)? + (x— 1)!° i 
49. Expand cos (x-+a) in powers of x. Ans. cosa—x sin a -5 cos a-+- 


as 31 rsin aži cos a—. 
50. Expand Inx in powers of (x— 1). Ans. e-)-7 e-+ e1 


-46t .. a 


51. Expand e* in a series of powers of (x-+2). Ans. a[i] 


52. Expand cos?x in a series of powers of (x-4) a 


53. Expand + in a series of powers of (x-++1). Ans. £ (n+-1) (n+ 1)" 


n=0 
(—2 < x <0). 
54. Expand tan x in a series of powers of (*-4). Ans. 14+2(x-4)+ 
i J 
+ (2-4) +.... 


Write the first four terms of the series expansion, in powers of x, of the 
following functions: 
2x5 17x? 


3 
55. tan x. Ans. r++ 15 +355 +.. 


cost Ea 4x4 Pe 
56. e°°%*, Ans. (1-5 — 750 st) 


57. e&tctan® Ans. ia ae ee : 
58. In (1 +e*). Ans. In2+— rte as . 
59. e" *, Ans. Het Š 4... B 

60. (1--x)*. Ans. Heyr... . 
61. sec x. Ans. +5434... ; 


62. In cosx. Ans. — 5—53 — = E 


3 5 7 
63. Expand sin kx in powers of x. Ans. pati pE 


64. Expand sin?x in powers of x and scene the interval a convergenc2. 
2x2 Byl 25x8 22n- 1y?n i 
Ans. a — a ter ..+(—1)” -1 n)! —s—— +... . The series converges for 
all values of x. 
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65. Expand rre in a power series of x. Ans. 1—x?+x!—x6+.... 


66. Expand arctan x in a power series of x. 
e x 


Hint. Take advantage of the formula arctan x =E 
0 


x xd 
. Ans. t= tg 


x? 
-7t..-(-l<x<)). 


1 
67. Expand (+x) 
—l<x< 1). 


Using the formulas for expansion of the functions e*, sin x, cos x, In (1 +x) 
and (1-+x)" into power series and applying various procedures, expand the 
following functions in ae ve and determine the intervals of convergence: 


68. sinhx. Ans. att et —a0o <x <0). 


in a series of powers of x. Ans. 1—2x-+3x?—4x3-+... 


69. cosh x. Ans. 1+5 atat . (— œ< x < œ). 


j)” (2x)?” 


70. cos? x. Ans. 1+7 È Coe (—œ< x <0). 


71. (1+x) In (14x). Ans. +È- 1)» Gone aE (x]<1). 


72. (I-+-x)e-*. Ans. 43 (—tyr-t 21 gn (a < x< o). 
n=2 
ex — |] x 3 
73. cea Ans > Zalef V2). 74,5. Ans Ite+at 
nal 1 2 
+. AS fi(—00 <x <o) 75. ya Ans. 2 (ntl)x" (|x| <1). 
76. e* sin x. Ans. xp arp Se Se 5 Liag 2” sin me (—œ<x< 0). 


77. In (x+ VIF x2). Ans. x— a an 
1.3... (2n— 2n+ 
bootie tag ae 


IED ae, Ans. Y, (Het žy (<1). 


a 


+... (lex). 
78. 


arc tan x 


+1 
dx. Ans. a 1)" omni (—lax<l). 


2n 
80. f EOSIN Ay Ans. Clit È fay Ga (—0o<x<0 and0<x< 0). 
a= 
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a dz 2 9n-8 
xn- 
81. CS . Ans. ns" 
0 n=1 
82. Prove the equations 
sin (a + x) = sin a cos x + cos a sin x 
cos (a + x) = cos a cos x— sin a sin x 
by expanding the left sides in powers of x. 


Utilizing appropriate series, compute: 
83. cos 10° to four decimals. Ans. 0.9848. 84. sin1l° to four decimals. 


Ans. 0.0175. 85. sin 18° to three decimals. Ans. 0.309. 86. sin + to four de- 


cimals, Ans. 0.7071. 87. arctan t to four decimals. Ans. 0.1973. 88. In5 to 


three decimals. Ans. 1.609. 89. logy)5 to three decimals. Ans. 0.699. 


90. arcsin 1 to within 0.0001. Ans. 1.5708. 91. Ve to within 0.0001. 
Ans. 1.6487. 92. loge to within 0.00001. Ans. 0.43429. 93. cos! to within 
0.00001. Ans. 0.5403. 


Using a Maclaurin series expansion of the function f (x)= WA a"-+ x, com- 
pute to within 0.001: 


94. 7/30. Ans. 3.107. 95. V70. Ans. 4.121. 96. j/500. Ans. 7.937. 


97. 7/250. Ans. 3.017. 98. V 84. Ans. 9.165. 99. 7/2. Ans. 1.2598. 
Expanding the integrand in a series, compute the integrals: 


1 
100. (ite to five decimal places. Ans. 0.94608. 101. (ens ax to four 
0 
n 
T 


decimals. Ans. 0.7468. 102. f sin (x?)dx to four decimals. Ans. 0.1571. 
0 


0.5 


arctan x 
“x 


1 
7 

103. fe Vx dx to two decimals. Ans. 0.81. 104. ——— dx to three decimal 
0 


0 
1 


places. Ans. 0.487. 105. { cos Vx dx to within 0.001. Ans. 0.764, 
0 
1x 


106. \ In (t+ Vx) dx to within 0.001. Ans. 0.071. 107. i T dx to within 


Otn a 


0.0001. Ans. 0.9226. 108. dx to within 0.0001. Ans. 0.0214. 


0.5 1 
2 
109. È Sto within 0.001. Ans. 0.494. 110. (EED an, Ans. $. 
l+ x 
0 


12 
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Note. When solving this exercise and the two following ones it is well to 
bear in mind the equations: 


@o ao 

l x (—1)"-!_ an? Il ā mæ 

2 nm 6’ 2 n2? 12° H3 BaD 8 
n=l n=l asl 


which will be established in Sec. 5.2. 


1 1 
= a 3 
M11. (ao ae. Ans. =. 112. fin Tere ee Ans. =. 
7 x 6 , —x x 


Integrating Differential Equations 
by Means of Series 


113. Find the sounen of the equation y”=xy that satisfies the initial con- 
ditions for x=0, y=1, y’=0. 


Hint. Look pte solution in the form of a series. Ans. ltepteeect 
+... +3756. GIT 
114, Find the dn. of the oaio y” +xy’ EA as that aaa the initial 


+1y8n-1 
conditions for x=0, y=0, y’=1. Ans. x— +53 35T ee HTS.. aLi 
115. Find the general solution of the equation 


" , 1 
xy” + xy +e -7) y=0 
Hint. Seek the solution in the form, p r E AATE 
e fee eg -7 poe = 
Ans. C,x |: at Bi ape: + Cx 1 Star os 
=c, $ Eyo, E, 
116. Find the solution of the equation xy’ +y +xy=0 that satisfies the 
initial conditions for x=0, y=1, y'=0. Ans. 1— ž 
ak 
+ HDS Grp tT 
Hint. The last two differential equations are particular cases of the Bessel 
equation 
i xy" + xy! +n) y=0 


BtTaynTearet 


for n=5 and n=0. 


117. Find the general solution of the equation 
4xy” + 2y’+y=0 
Hint. Seek the solution in the fom of a series xP (a9 -+ a,x +a +...) 
Ans. Cicos Vx +Czsin Vx 
118. Find the solution oi the PR TA (1 — x?) y” —xy' =0 that satisfies the 
initial conditions y=0, y’=! when x=0. Ans. x +e Sty tee 


13 5 x? 
Tea gp 
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119. Find the solution of the equation (1 +x?) y”+2xy'’=0 that satisfies 
the initial conditions y=0, y’=1 when x=0. Ans. PE 2 

120. Find the solution of the equation y”=xyy’ that satisfies 
the initial conditions y=1, y’=1 when x=0. Ans. HHAH 


3x5 
+ srt: eee 

121. Find the solution of the equation (1—x) y’=1-+x—y that satisfies 
the initial conditions y=0O when x=0, and indicate the interval of conver- 

2 4 
gence of the series obtained. Ans. tahae (-l<x<l). 

122. Find the solution of the equation xy”-+y=0 that satisfies the initial 
conditions y=0, y’=1 when x=0 and indicate the interval of convergence. 
A PE ees +t at 

ns. X— ap Vanes @ne4’ CE 
{—æ < x <0). 5 
123. Find the solution of the equation ytz +y=0 that satisfies the 


initial conditions y=1, y’=1 when x=0. Ans. me, 


124. Find the solution of the equation ytt y'+y=0 that satisfies the 
initial conditions y=1, y’=0 when x=0, and indicate the interval of con- 


` ; x? x4 x8 
vergence of the series obtained. Ans. l-z tap apga tt 


` xan 
+D" agape (|x| <œ). 


Find the first three terms of the power-series expansion of the solutions òf 
the following differential equations for the given initial conditions: 


125. y’=x?+y?; for x=0, y=1. Ans. Heto pp 
ex? p 


126. y"=8 +x; for x=0, y=l, y’=0. Ans. I+—-+3+-- . 
; : L x8 
127. y'=sin y—sin x; for x=0, y =0. Ans. -7 5T 


Find several terms of the series expansion of solutions of differential equa- 
tions under the indicated initial conditions: 
x? 2x8 


128. y"=yy'—x? when x=0, y=1 and y’=1. Ans. It+e+ 5 +3 + 


3x4, 14x8 i vette = 1 ie 
+3+Grt+:: . 129. y’ =y*®+25 when x=0 and y=5- Ans. pager 


1 9 . 
+5 etg tte tt... 130. y’=x*?—y? when x=0 and y=0. 
1 
Ans. șa trg ttn... . 131. y'=x?y2?—1 when x=0 and 
B A xb ; 
y=1. Ans. Il—x-p pte 132. y’=e¥+xy when x=0 


2 4 
and y=0. Ans. HiH et. s 


CHAPTER 5 


FOURIER SERIES 


5.1 DEFINITION. STATEMENT OF THE PROBLEM 
A functional series of the form 
Sta, cos x +b, sinx-+a,cos2x+6,sin2x+... 


or, more compactly, a series of the form 
24> (a, cos nx +b, sin nx) (1) 
n=l 


is called a trigonometric series. The constants a,, a, and 6, 
(n=l, 2, ...) are called. coefficients of the trigonometric series. 
If series (1) converges, then its sum is a periodic function f(x) 
with period 2m, sincé sinnx and cosnx are periodic functions 
with period 2x. 
Thus, 


Fx) =F (e+ 2n) 


Let us pose the following problem. 

Given a function f(x) which is periodic and has a period 2n, 
Under what conditions for f(x) is it possible to find a trigonomet- 
ric series convergent to the given function? 

That is the problem that we shall solve in this chapter. 

Determining the coefficients of a series from Fourier’s formulas. 
Let the periodic function f(x) with period 2% be such that it may 
be represented as a trigonometric series convergent to a given 
function in the interval (—x, x); i.e., that it is the sum of this 
series: 


f (x)= 2 + > (a, cos nx +b, sin nx) (2) 
n=1 


Suppose that the integral of the function on the left-hand side 
of this equation is equal to the sum of the integrals of the terms 
of the series (2). This will be the case, for example, if we assume 
that the numerical series made up of the coefficients of the given 
trigonometric series converges absolutely; that is, that the 
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following positive number series converges: 
+]a,|+10,|+[a2]+]b.)+---+len]t+lol+.-- (3) 


Then series (1) is dominated and, consequently, it may be inte- 
grated termwise in the interval from —n ton. Let us take advan- 
tage of this for computing the coefficient a,. 

Integrate both sides of (2) from —ax to +x: 


a 
2 


e 1 œ x x 
(F(a = (Barty ( fa, cos nx dx + fo, sin nx de) 
= ar n=1 \-nx on J 
Evaluate separately each integral on the right side: 
x 
\2ar= Nay 
-xn 
n n , 
fa, cos nx dx = a, f cosnxdx =% nxin o 
n -x 
-n -x 
z x 
(6, sin nxdx=6, {sin nx dx = —b, cos nx | =0 
n |-% 
-n p 
Consequently, 
n 
f f (x) dx =na, 
-n 
whence 
l x 
-3 


To calculate the other coefficients of the series we shall need 
certain definite integrals, which we will consider first. 

If n and k are integers, then we have the following equations: 
if nk, then 


n 
f cos nx cos kxdx=0 


-x 
n 


f cos nx sin kx dx = 0 (1) 


=n 
n 


f sin nx sin kx dx =0 
3 J 


5.1 Definition. Statement of the Problem 329 
but if n=k, then 


n 
f costkxdx=n à. 


-1 
a 
f sin kx cos kxdx =0 (II) 
-n 


n 
sin? kx dx = n 
-7 


To take an example, evaluate the first integral of group (I). 
Since 


cosnx cos kx = + [cos (n + k) x + cos (n — k) x] 
it follows that 


a a m 
f cos nx cos kx dx =4 { cos (n +k) xdx +4 f cos (n—k)xdx =0 
-x -7 -a 


The other formulas of (I)* are obtained in similar fashion. The 
integrals of group (II) are computed directly (see Ch. 10, Vol. I). 
Now we can compute the coefficients a, and bẹ of series (2). 
To find the coefficient a, for some definite value k540, mul- 
tiply both sides of (2) by cos kx: 


f (x) cos kx = I cosks +Y (a, cos nx cos kx +b, sin nxcos kx) (2’) 
n=l 
The resulting series on the right is dominated, since its terms do 
not exceed (in absolute value) the terms of the convergent positive 
series (3). We can therefore integrate it termwise on any interval. 
Integrate (2’) from — n to a: 


m m 
f f (x) cos kx dx = f cos kxdx 


© 7 n n 
+5 (a, f cos nxcoskx dx + b, f sin nx-cos kx dx 
n=1 -7 


-7 


Taking into account formulas (II) and (I), we see that all the 
integrals on the right are equal to zero, with the exception of the 


* By means of the formulas 
cos nx sin kx = !/; [sin (n+ k) x —sin (n— hk) x] 
sin nx sin kx =1/, [— cos (n+ k) x+ cos (n— k) x] 
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integral with coefficient a,. Hence, 


n n 
f f (x) cos kx dx = a, f cos? kx dx = apn 
whence 7 = 
n 
a, =} f f (x) cos kx dx (5) 


-n 
Multiplying both sides of (2) by sinkx and again integrating 
from —a to x, we find 


n n 
f f (x) sin kx dx = bp f sin? kx dx = b,n, 
whence 4 = 
n 
b=} f f (x) sin kx dx (6) 
-x 


The coefficients determined from formulas (4), (5) and (6) are 
called Fourier coefficients of the function f(x), and the trigono- 
metric series (1) with such coefficients is called a Fourier series 
of the function f(x). 

Let us now revert to the question posed at the beginning of 
this section: What properties must a function have so that the 
Fourier series constructed for it should con- 
verge and so that the sum of the const- 
ructed Fourier series should equal the va- 
lues of the given function at correspon- 
ding points? We shall here state a theorem 
that will yield sufficient conditions for 
representing a function f(x) by a Fourier 
series. 

Definition. A function f(x) is called 
piecewise monotonic on the interval [a, b] 
if this interval may be divided by a finite 
number of points x,, Xa, ..., X,;-, into sub- 
intervals (a, x,), (Xis Xa) .-+) (%,-y b) such that the function 
is monotonic (that is, either nonincreasing or nondecreasing) on 
each of the subintervals. . 

From the definition it follows that if the function f(x) is piece- 
‘wise monotonic and bounded on the interval [a b], then it can 
have only discontinuities of the first kind. Indeed, if x=c is 
a point of discontinuity of the function f(x), then, by virtue of 
the monotonicity of the function, there exist the limits 


tim f@)=F(C—), lim f(x) =f (+0) 
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i.e., the point c is a discontinuity of the first kind (Fig. 125) 
We now state the following theorem. 

Theorem. /f a periodic function f(x) with period 2x is piecewise 
monotonic and bounded on the interval [— x, n}, then the Fourier 
series constructed for this function converges at all points. The sum 
of the resultant series s(x) is equal to the value of f(x) at the 
points of its continuity. At the discontinuities of f(x), the 
sum of the series is equal to the arithmetic mean of the limits of 
f(x) on the right and on the left; that is, if x=c is a disconti- 
nuity of the function f(x), then 


s (x), 222 EA +0) 


From this theorem it follows that the class of functions that 
may be represented by Fourier series is rather broad. That is why 
Fourier series have found extensive applications in various divi- 
sions of mathematics. Particularly effective use is made of Fourier 
series in mathematical physics and its applications to specific 
problems of mechanics and physics (see Ch. 6). 

We give this theorem without proof. In Secs. 5.8-5.10 we will 
prove another sufficient condition for the expandability of a func- 
tion in a Fourier series, which condition in a certain sense deals 
with a narrower class of functions. 


5.2 EXPANSIONS OF FUNCTIONS IN FOURIER SERIES 
The following are some instances of the expansion of functions 
of Fourier series. 
Example 1. A periodic function f(x) with period 21 is defined as follows: 
f(x)=x, ~na < xan 


This function is piecewise monotonic and bounded (Fig. 126). Hence, it 
admits expansion in a Fourier series. 


Fig. 126 
By formula (4), Sec. 5.1, we find a 
1 e 1 x3 
x2 |x 
m= f rie T a= 
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Applying formula (5), Sec. 5.1, and integrating by parts, we find 


n n 
y= f x cos waca "F f sin xar |o 
-7 


-n 
By formula (6), Sec. 5.1, we have 


n 
n=> f ronid | SH E 


n 
x 1 
ee =(—])k+1 L 
or E { cos tes] (—1) k 
-n 


k 


Thus, we get the series 


place S ack —])k+1 > 2" 
i 5 y e Ct) a ee ee 
This equation occurs at all points except at points of discontinuity. At each 


discontinuity, the sum of the series is equal to the arithmetical mean of its 
limits on the right and left, which is zero. 


f(x) =2 [= x sin2x . sin3x sin kx | 


fn -4n In -n-an A| n 2n Sn 4n Sa 


Fig. 127 


Example 2. A periodic function f(x) with period 2m is defined as follows: 


fx) =—x for -—n<xx<0 
f(x)=x for O<xan 


{or f (x)=|x|] (Fig. 127). This function is also piecewise monotonic and boun- 
ded on the interval -—n<xxv<n. 
Let us determine its Fourier coefficients: 


1° fe t 
=> Josen [5 (— x) s ra =n 


0 n 
a= i (— x) cos kx dx- È x cos kx a 
-x 0 


-7 


0 x 
1 x sin kx |o 1 , xsinkxjt 1 ; 
-1|- ; | +7 J sin kx dx-+ k ae ra] 
-xn 
0 for k even 


x 2 4 
| = pr (os kn—1) = — ggr for k odd 


0 


l cos kx |0 cos kx 
=|- k [at k 


0 d 7| 
nat] f (— x) sin kxdx-+ | xsin kx dx |=0 


-x 0 
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We thus obtain the series 
m4 cosx , cos 3x , cos 5x cos (2p-+-1) x 
A ake near [Set ee pet + Ee.) 
This series converges at all points, and its sum is equal to the given function. 
Example 3. A periodic function f(x) with period 2n is defined as follows: 
f(x)=—1 for —n<x<0 
f (x) =1 for OKIN 


This function (Fig. 128) is piecewise monotonic and bounded on the interval 
IKST. 


Fig. 128 


Let us compute its Fourier coefficients: 


n 0 n 
a= f roai | aes far] 
0 


-n -1 
i 0 x in kx |0 in k: 
sin kx sin kx | 
ont | (ons bede f costed |=— 1: kn bane kn 05° 
a ô 
| 0 X 1 kx |0 k 
, cos kx cos kx |x 
E] k ce k | 
=n 


2 0 for k even 
=p los had aks We tork odd 
nk 


Consequently, for the function at hand the Fourier series has the form 
_ 4 [sinx | sin3x , sin5x sin (2p +1) x 
I= > [SS | 


This equation holds at all points with the exception of discontinuities. 
Fig. 129 illustrates how the partial sums s, of the series represent more and 
more accurately the function f(x) as n + œ. 
Example 4. A periodic function f(x) with period 2x is defined as follows: 
F=, —nexan (Fig. 130) 
Determine its Fourier coefficients. 
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53= 


4 sings MIT + sigda) 


n 
| 2 si 
a= f x? cos pede | ant 


n 
i -2 F esnean 
-7 k 


-x1 


— 2 | _xcoskx 
oe k 


mu 
n 1 . 
ntk f cos tet 
Si i 
E for k even 


4 
=—, [2 cos kn] = 
2 
K S for k odd 
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n n 
2 
ARA f einer de= | ee 2 f x cos kx dx 
n 1 k k 


-xn -n 
Š e n 
2 | xsin kx |x 1 : 
= FE k R f sin sa |=o 
Y -xn 
Thus, the Fourier series of the given function has the form 
2 V 4 (cos *__cos 2x , cos 3x 
acest nd a 2 3 


Since the function is piecewise monotonic, bounded and continuous, this equa- 
tion holds at all points. 
Putting x=n in the equation obtained, we get 


o 


n=l 
Example 5. A periodic function f(x) with period 27 is defined as follows: 
f(x)=0 for —n<x<0 
f(x)=x for O<x<an (Fig. 131) 


Fig. 131 


Determine the Fourier coefficients: 


| 


x n 
a=} f x05 wani singt oe) kx dx 
0 


0 for k even 


ren 
a one 


2 
1 cos kx jn l — aR for k odd 


n 
n=} fx sin kedes | ecos 
n 1 k 
0 
E for k odd 
n k 
== cos kn = l 
—— for k even 


k 
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The Fourier series will thus have the form 
nm 2 /cosx , cos 3x , cos 5x sinx sin2x , sin3x 
fags (Set tg t+ (FE a g a] 


At the discontinuities of the function f(x), the sum of the series is equal to 


the arithmetic mean of its limits on the right and left (in this case, to the 


n 
number +). 
Putting x =0 in the equation obtained, we get 


(ool 


5.3 A REMARK ON THE EXPANSION OF A PERIODIC 
FUNCTION IN A FOURIER SERIES 


We note the following property of a periodic function p(x) with 


period 27: 
n Atn 


| p(x)dx= N p(x) dx 


-n 
no matter what the number A. 


Indeed, since 
p (E— 2x) =p ($) 
it follows that, putting x=&—2n, we can write (for all c and d): 


d. d+27 d+27 d+27 
(par= | pe—anat= | p@at= | pad 
c C+ 20 CHN CHIN 
In particular, taking c = — n, d=A, we get 
a A+ on 


f p (x) dx = f ap (x) dx 


-xn 


therefore, 
A+27 -x n A+ 20 
| w(x)de= f pede + | pidr+ | p(xide 
a a -x x 
-7 n a n 
=f plxdet | yde + | pede = f (ade 
a -n -2n -x7 


This property means that the integral of a periodic function 4 (x) 
over any interval whose length is equal to the period always has 
the same value. This fact is readily illustrated geometrically: the 
cross-hatched areas in Fig. 132 are equal. 
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From the property that has been proved it follows that when 
computing Fourier coefficients we can replace the interval of in- 
tegration (— n, x) by the interval of integration (A, A+ 27), that 
is, we can put 7 


A+ 27 A+2n 
a= + f fade, a,=+ f f (x) cos nx dx 

x À 

A+ 20 (1) 
ba =t f f (x) sin nx dx | 

x 


where A is any number. 


ae 


-3n -2n -1 0 n andr 3n 4n A+2n SR 
Fig. 132 


This follows from the fact that the function f(x) is, by hypothe- 
sis, periodic with period 2m; hence, both the functions f (x) cosnx 
and f(x)sinnx are periodic functions with period 2x. We now 
illustrate how this property simplifies the process of finding coef- 
ficients in certain cases. 


JY 


T 


-7 0 n 2n In 4n 
Fig. 133 


-271 SN 6n 7n 6n T 


Example. Let it be required to expand in a Fourier series the function 

f (x) with period 2x, which is given on the interval 0< x < 2a by the equation 
f =x 

The graph of f(x) is shown in Fig. 133. On the interval [— x, x] this func- 
tion is represented by two formulas: f(x)=x+2n on the interval [— x, 0] 
and f(x)=x on the interval [0, n]. Yet, on [0, 2n] it is far more simply 
represented by a single formula f(x)=x. Therefore, to expand this function 
in a Fourier series it is better to make use of formulas (l), setting A=0: 
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+ =0 


Qn 2n 
1 1 1 [xsinnx , cosnx]|2x 
Anr =— x) cos nx dx = — \ x cos nx dx = — | —— + —,— 
Boh 1 n n nè jo 


a 

1 1 1 xcosnx , sinnx | 2% 2 
wii f(a) sin med | xsin nede = | — APE y a 
0 


Cietie, 


; VAER 2a Do 2 
f(x)=n—2sinx—- sin 2x — z sin 3x — 7 sin 4x —— sin 5x—... 


This series yields the given function at all points with the exception of points 
of discontinuity (i.e., except the points x=0, 2x, 4m, ...). At these points the 
sum of the series is equal to the half sum of the limiting values of the function 
f (x) on the right and on the left (to the number x, in this case). 


5.4 FOURIER SERIES FOR EVEN AND ODD FUNCTIONS 


From the definitions of an even and odd functions it follows 
that if p(x) is an even function, then 


( yp (x) dx = 2f 9a) de 


Indeed, 


n 0 1 n n 
{ v(x)dx= f Vaea a ae Bl 
0 


=f vdr (wlndrn2 2f va) de 


since, by the definition of an even function, ae x)= (x). 
It may similarly be proved that if p(x) is an odd TAA then 


7 pad= fo adrt f ood =—[e@)de+(o@ydr=o 
-7 0 

If an odd function f(x) is expanded in a Fourier series, then 
the product f(x)coskx is also an odd function, while f (x) sin kx 
is an even function; hence, 


a= È f(x)dx=0 
a, => f (x) cos kx dx =0 (1) 


xu m 
br =+ f F(x) sinkede f f0) sinkede 


-7 
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Thus the Fourier series of an odd function contains “only sines” 
(see Example 1, Sec. 5.2). 

If an even function is expanded in a Fourier series, the pro- 
duct f(x)sinkx is an odd function, whfle f(x)coskx is an even 
function and, hence, 


a= 2 fd 


0 
n 

a, = =f f (x) cos kx dx (2) 
0 


n 
=i f Í (x) sin kx dx =0 
-n 


Thus, the Fourier series of an even function contains “only cosines” 
(see Example 2, Sec. 5.2). 

The formulas obtained permit simplifying computations when 
seeking Fourier coefficients in cases when the given function is 
even or odd. It is obvious that not every periodic function is 
even or odd (see Example 5, Sec. 5.2). 


Example. Let it be required to expand in a Fourier series the even function 
f (x) which has a period of 2x and on the interval [0, n] is given by the equ- 
ation 

y=x 

We have already expanded this function in a Fourier series in Example 2, 
Sec. 5.2 (Fig. 127). Let us again’ compute the Fourier series of this function, 
taking advantage of the fact that the given function is even. 

By virtue of formulas (2) 6,=0 for any k; 


n 2 x 
a== È xdr=a, a= | x cos kx dx 
0 


0 
0 for k even 


__ 2 fxsinkx , cos kx k T 
== | a ik =pl) aie ec k odd 


We obtained the same coefficients as in Example 2, Sec. 5.2, but this time by 
a short cut. 


5.5 THE FOURIER SERIES FOR A FUNCTION 
WITH PERIOD 22 


Let f(x) be a periodic function with period 2/, generally 
speaking, different from 2x. Expand it in a Fourier series. 
Make the substitution 


22 * 
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Then the function (£) will be a periodic function of ¢ with 


period 27. 
It may be expanded in a Fourier series on the interval — n < 
<x: 


t(+)=%+ A S hb psi es) (1) 
k= 


where 


q= f P(E tjat, a => f Flat ) cos ke d! 
-0 


-1 


b= | ($) sin kt dt 


Now let us return to the original variable x: 
x=—t, t=xļ, di=tdx 
We will then have 


l I 
a= | F(x)dx, a= J f (x) cosk -xdx 
=l -=i 


1 (2) 
1 n 
b=> \ f(x) sink — xdx 
rd j 
Formula (1) takes the form 
fo)=24 (a, cos Fx +b, sin x ) (3) 
k=1 


where the coefficients a,, agp, bg are computed from formulas (2). 
This is the Fourier series for a periodic function with period 2l. 

We note that all the theorems that hold for Fourier series of 
periodic functions with period 2m hold also for Fourier series of 
periodic functions with some other period 2/. In particular, the 
sufficient condition for expansion of a function in a Fourier series 
(see end of Sec. 5.1) holds true, as do also the remark on the 
possibility of computing coefficients of the series by integrating 
over any interval whose length is equal to the period (see Sec. 5.3), 
and the remark on the possibility of simplifying computation of 
coefficients of the series if the function is even or odd (Sec. 5.4). 


Example. Expand in a Fourier series the periodic function f(x) with period 
21 which on the interval [— /, /] is given by the equation f (x)=|x| (Fig. 134). 
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Solution. Since the function at hand is even, it follows that 


l 
bg <0) a=} frap! 
0 


A l n ji n 0 for k even 
az) x cos sae =a x cos kx dx = a 4l for k odd 
n nk? 
0 0 


Fig. 134 
Hence, the expansion is of the form 
ll 2 oe cos ae cos Peru, | 
Itl=o-a i Tg tte T 


5.6 ON THE EXPANSION OF A NONPERIODIC FUNCTION 
IN A FOURIER SERIES 


Let there be given, on some interval [a, b], a piecewise mono- 
tonic function f(x) (Fig. 135). We shall show that this function 
f(x) may be represented in the form of a sum of a Fourier series 


Fig. 135 


at the points of its discontinuity. To do this, let us consider an 
arbitrary periodic piecewise monotonic function f, (x) with period 
2u >b—a, which coincides with the function f(x) on the inter- 
val [a, b]. [We have redefined the function f(x).] 

Expand f, (x) in a Fourier series. At all points of the interval 
[a, b] (with the exception of points of discontinuity) the sum of 
this series coincides with the given function f(x); in other words, 
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we have expanded the function f(x) in a Fourier series on the 
interval [a, b 

Let us now consider the following important case. Let a func- 
tion f(x) be given on the interval (0, /]. Redefining this function 
in arbitrary fashion on the interval [—J, 0] (retaining piecewise 
monotonicity), we can expand it in a Fourier series. In particular, 
if we redefine this function so that when —1 <x <0, f(x) =f(—x), 
we will get an even function (Fig. 136). [In this case we say that 
the function f(x) is “continued in 
even fashion”.] This function is ex- 
panded in a Fourier series that con- 


y 


Fig. 136 Fig. 137 


tains only cosines. Thus, we have expanded in cosines the function 
f (x) given on the interval [0, 4]. 

But if we redefine the function f (x) when — L <x <0 as follows: 
f (x) =— f (— x), then we get an odd function which may be expand- 
ed in sines (Fig. 137). [The function f(x) is “continued in odd 
fashion”.] Thus, if on the interval [0, /] there is given some piece- 
wise monotonic function f(x), it may be expanded in a Fourier 
series both in cosines and in sines. 


Example 1. Let it be required to expand the function f (x)= x in the sine 
series on the interval [0, x). 
Solution. Continuing this function in odd fashion (Fig. 126), we get the series 


sinx sin2x , sin3x 
ae [4-3 +-...| 
(see Example 1, Sec. 5.2). 
Example 2. Expand the function f (x)=x in the cosine series on the interval 
(0, 


mt). 
Solution. Continuing this function in even fashion, we get 
f= —t< xan 
(Fig. 127). Expanding it in a series we find 


cosx , cos 3x , cos 5x , - 
1-5-5 [5 +H 32 + 5a +] 
(see Example 2, Sec. 5.2). And so on the interval [0, n] we have the equation 
z= 2 n 4 ss x , cos 3x , cos 5x | 


2 ga 3? H-5 53 Pit 
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5.7 MEAN APPROXIMATION OF A GIVEN FUNCTION 
BY A TRIGONOMETRIC POLYNOMIAL 


Representing a function by an infinite series (Fourier’s, Taylor’s 
and so forth) has the following meaning in practice: the finite 
sum obtained in terminating the series with the nth term is an 
approximate expression of the function being expanded. This .appro- 
ximate expression may be made as accurate as desired by choosing 
a sufficiently large value of n. However, the character of the 
approximate representation may 
differ. 

For instance, the sum of the 
first n terms s, of a Taylor se- 
ries coincides with the function 
at hand at one point, and at 
this point has derivatives up to 
the nth order that coincide with 
the derivatives of the function 
under consideration. An ath Fig. 138 
degree Lagrange polynomial (see 
Sec. 7.9, Vol. I) coincides with the function under consideration 
at n+1 points. 

‘ Let us see what the character is of an approximate represen- 
tation of a periodic function f(x) ‘by trigonometric polynomials 
of the form 


Sy (x) =F +Y a cos kx +b, sin kx 


k=1 


where a, Q,, bis Qa, bas .--, Gy, 5, are Fourier coefficients; that 
is, by the sum of the first n terms of a Fourier series. We first 
make several remarks. 

Suppose we regard some function y= f(x) on the interval ‘[a, b] 
and want to evaluate the error when replacing this function by 
another function ọ (x). For the measure of error we can, for in- 
stance, take max |f(x)—@(x)| on the interval [a, b], which is 
the so-called maximum deviation of p(x) from f(x). But it is 
sometimes more natural to take for the measure of error the so-called 
root-mean-square deviation 6, which is defined by the equation 


b 
Seo) [Fo —@ (x)]* adx 


Fig. 138 illustrates the difference between the root-mean-square 
deviation and the maximum deviation. 

Let the solid line depict the function y= f (x), the dashed lines 
the approximations g,(x) and g,(x). The maximum deviation of 


344 Ch. 5 Fourier Series 


the curve y= Q, (x) is less than that of the curve y= ọ, (x), but the 
root-mean-square deviation of the first curve is greater than that of 
the second because the curve y= Q, (x) is considerably different from 
the curve y=f(x) only on a narrow section and for this reason 
characterizes the curve y= f(x) better than the first. 

Now let us return to our problem. 

Let there be given a periodic function f(x) with period 2n. 
From among all the trigonometric polynomials of order n 


+h (a, cos kx + Bp sin kx) 
k=l 
it is required to find (by choice of the coefficients a, and f,) that 
polynomial for which the root-mean-square deviation defined by the 
equation 
l x a n 2 
õi = f [ro-3-$ c cos kx + B, sin e| dx 
-n k=1 

has the smallest value. 

The problem reduces to finding the minimum of the function 
of 2n+1 variables a,, a, ..., Qp Bo Bo <.. Bno 

Expanding the square under the integral sign and integrating 
termwise, we get 


ô= ( fr (x)—2f EEP (a, cos kx + B, sin en | 


-7 


[ei (a, cos kx -+ Bp sin e | a 


k=1 J 
1 x nu 
=i f P (x) dx— $t T fode- F La f f (x) cos kx dx 
=r k=1 -7 
bes W a tue e 
== Baf F (x) sin kedet % 5 dx+ 5- 2 an { cos? kxdx 
k= -n k id 
1 n f f 
+s - BR \ sin? kx dy La co" 
an k=l -7 i p = 
i n A A! A 
+55 % > i ( in ky dx -} = X pO; í cos kx cos jxdx 
k=! T k=1j=1 -i 
kj 


+ 
al- 
Me: 
Me 
= 
I> 
C34 

S 

an 

= 

a 

N 

5 
pa 

ss 

Aa 
+ 
al—- 
Ma 
Ma 


PR; l sin kx sin jx dx 


lj=i -r 
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We note that 


q J F@)de=a, = È f(x) cqskx dear 


n- 
= f f (x) sin kx dx = bp 
-x 


are the Fourier coefficients of the function f(x). 
Further, by formulas (I) and (II), Sec. 5.1, we have: for k=j 


x x 
f cos? kxdx =n, f sin? kx dx = 7 
-n -7 x 


for arbitrary k and j 


x 
f sin kx cos jx dx =0 
-x 


and for kÆ j 
T n 
f cos kx cos jx dx =0. f sin kx sin jx dx =0 
-7 -7 


Thus, we obtain 


m 
= | Poda — E amt Bab) ponl Leite 
-7 =l =1 
Adding and subtracting the sum 
45 Dato 
k=1 


we will have 


bat | Podi D toH e—a) 
-7 k=1 


+ 4 £ [(%p — ax)? + (Be — Bp)" ] (1) 
k=1 


The first three terms of this sum are independent of the choice 
of coefficients a, @,, ..., @,, By, ..., B,. The remaining terms 


- (a, — 4)? + + >» [(a — ar)? + (Bp —9,)?] 
k=1 


are nonnegative. Their sum reaches the least value (equal to zero) 
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if we put a,—a,, @=a,, ..-, Gp=Qy B=), ..., Bn= br 
With this choice of coefficients @,, @,, ..., @ns By ..-, B, the 
trigonometric polynomial 


w4 DAG" cos kx + B, sin kx) 
k=1 
will least of all differ from the function f(x) in the sense that in 
such a choice of coefficients the square deviation 62 will be the least. 

We have thus proved the theorem: 

Of all trigonometric polynomials of order n, that polynomial has 
the least root-mean-square deviation from the function f(x), the 
coefficients of which polynomial are the Fourier coefficients of the 
function f (x). 

The least square deviation is 


1 ¢ a lë 
ô= | Po de—F— y D (+o) (2) 
-7 k=1 
Since 62>>0, it follows that for any n we have 


Pde Ss Std Naty 
-n k=1 


Hence, the series on the right converges (as n— œo), and we 
can write 


1 fr (x) oF ye (ak +08) (3) 


This relation is called Bessel’s inequality. 

We note without proof that for any bounded and piecewise 
monotonic. function the root-mean-square deviation obtained upon 
replacing the given function. by the nth partial sum of the Fourier 
series tends to zero as n— œ, that is, 62-—+0 as n— œ. But 
then from formula (2) there follows the equation 


P (x) dx (3’) 


L 
n 


z+ I at= 
k=1 


ica 


which is called the Lyapunov-Parseval equation. We note that 
this equation has been proved for a broader class of functions 
than that which we here consider. 

From what has been proved it follows that for a function which 
satisfies the Lyapunov-Parseval equation (in particular, for any 
bounded piecewise monotonic function), the corresponding Fourier 
series yields a root-mean-square deviation equal to zero. 
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Note. Let us establish a property of Fourier coefficients that 
will be needed in the future. We first introduce a definition. 

A function f(x) is called piecewise continuous on an interval 
{a, b] if it has a definite number of discontinuities of the first 
kind on this interval (or is everywhere continuous). 

We shall prove the following proposition. 

If a function f (x) is piecewise continuous on the interval [— x, 7], 
then its Fourier coefficients approach zero as n— œ; that is, 

lim a,=0, lim 6,=0 (4) 

Proof. If the function f(x) is piecewise continuous on the inter- 
val [— x, a], then the function f?(x) too is piecewise continuous 

m 


on this interval. Then f F (x) dx exists and is a finite number. * 
In this case, from the Bessel inequality (3) it follows that the 


series >) (a2-+62) converges. But if the series converges then its 
n=l 

general term approaches zero; in this case, lim (a2-+53)=0. 

Whence we get equations (4) directly. Thus, the following equations 

are valid for a piecewise continuous and bounded function: 


n 
lim f f (x) cosnxdx =0 
now `n 

n 


lim | f(x) sin nxdx = 0 


n> on 


If a function f(x) is periodic with period 2n, then the latter 
equations may be written as follows (for any a): 


a+27 a+27 
lim f f (x) cosnx dx =0, lim f f (x) sin nxdx=0 
n= o a n> o a 


We note that- these equations continue to hold if in the integrals 
we take any arbitrary interval of integration [a, b], which is to 
say that the integrals 


b b 
(Fæ) cosnxdx ‘and Wie) sin nx dx 


‘ This integral may be presented as the sum of definite integrals of con- 
anus | Manet lors over the subintervals into which the interval [— x, x] is 
subdivide 
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approach zero when n increases without bound if f(x) is a bound- 
ed and piecewise continuous function. 

Indeed, taking b—a < 2n for definiteness, we consider the auxi- 
liary function ọ (x) with period 2n defined as follows: 


p(x) =f (x) when a <x <b 
@ (x) -- 0 when b <x <a-+2n 
Then 
b a+%n 
f f(x) cos nx dx = \ @ (x) cos nx dx 
“ ee 


b 

Wit sin nx dx = j @ (x) sin nx dx 

a a 
Since p(x) is a bounded and piecewise continuous function, the 
integrals on the right approach zero as n—+oo. Hence, the integ- 
rals on the left approach zero as well. Thus, the proposition is 
proved; that is, 

b 


b 
lim §f(x)cosnxdx=0, tim È f(x)sinnxde=0 (5) 
n>ta n> Oaa 


for any numbers a and b and any function f(x) piecewise cont- 
inuous and bounded on [a, b]. 


5.8 THE DIRICHLET INTEGRAL 


In this section we shall derive a formula that expresses the nth 
partial sum of a Fourier series in terms of a certain integral. This 
formula will be needed in the subsequent sections. 

Consider the nth partial sum of a Fourier series for the peri- 
odic function f(x) with period 2x: 


Sa) = + D (a, cos kx + by sin kx) 
where 


ELI x 
a=} | FO cosktdt, b=} | f(t) sinktat 
-n -n 


Putting these expressions into the formula for s, (x), we obtain 
n 
l 
sa) = z | fat 
n m k ink T 
+5 [= f F (£) cos kt dt + E f f(t) sin 
-7 ~n 


k=1 


5.8 The Dirichlet Integral 349 


or bringing coskx and sin kx under the integral sign (which is 
possible since coskx and sinkx are independent of the variable 
of integration and, hence, can be regarded as constants), we get 


a(x) = ae S Oat 
Pa È i f (f) coskxcosktdt + È f (f) sin kx sinkt a 


Now taking + outside the brackets and replacing the sum of integ- 
rals by the integral of the sum, we obtain 


s, (x) =~ f {29 + x [F (£) cos kx cos kt + f (£) sin kx sin ra} dt 
-7 k=1 
or 


S, (x) =1 f FH E $3 (cos kt cos kx + sin kt sin bs) at 
-1 k=1 


n 


-4 frog Seseto a (1) 
k=l 


-1 


Transform the expression in the brackets. Let 


9, (2) = +cosz+cos2z+ ... + cosnz 
then 
20, (z) cos z = cos z + 2 cos z cos z + 2 cos z cos 2z + .. 
P a (eon Bens oe} 
+ (cos 2z + cos 42) + . . . + [cos(n—1) z+ cos (n +1) z] 
= ] + 2cos z + 2cos2z+...+2cos(n—1)z+cosnz+cos(n+1)z 


or ; 
20, (z) cos z = 20, (z)— cos nz + cos (n + 1) z 
_cos nz — cos (n+ 1) z 
Oa (2) = 2 (1 — cos z) 
But 


cosnz—cos (n + 1) z= 2 sin (2n + 1) 5 sine 


— = i 22 
1—cosz=2sin 3 


350 Ch. 5 Fourier Series 


Hence, 


sin (2n + 1) 5 
o, (2) = —— 


y2 
2 sin > 


Thus, equation (1) may be rewritten as 


x 


A sin (20+ 1) *>* 
Sa (x)= z NFD — n dt 


2 sin —- 


-n 


Since the integrand is periodic (with period 2x), it follows that 
the integral retains its value on any interval of integration of 
length 2x. We can therefore write 


x+n 


1 sin (an 1454 
Sa) =z \ F(t) —_,.* it 


sin —- 


x-X 
Introducing a new variable a, we put 
t—x=a, t=x+a 


Then we get the formula 


x 
1 sin (20+ 1) > 
st) == \ f+) ——{— da (2) 
sin = 
2 


The integral on the right is Dirichlet’s integral. 
In this formula put f(x)=1; then a,=2, a,=0, 6,0 when 
k>0; hence, s,(x)=1 for any n and we get the identity 


x 


sin (2n + sinat) g 7 
da (3) 


as 


asin 
-n 


which we will need later on. 
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5.9 THE CONVERGENCE OF A FOURIER SERIES AT A GIVEN POINT 


Assume that the function f(x) is piecewise. continuous on the 
interval [— 7n, n]. ° 

Multiplying both sides of the identity (3) of the preceding 
section by f(x) and bringing f(x) under the integral sign, we get 


the equation 
m 


1 sin (Qn-+1) $ 
f (x)= z V) ———,—— da 


2sin > 
Py -n 

Subtract the terms of the latter equation from the corresponding 

terms of (2) of the preceding section; we get 
m 
T sin a+) 
StS | Lf (x +a) —f (x)] ———— da 
2 sin 7 

-n 


Thus, the convergence of a Fourier series to the value of a func- 
tion f(x) at a given point depends on whether the integral on the 
right approaches zero as n — œ. 
Let us break up this integral into two integrals: 
a 
a 
1 cos > , 
s, (9) —f (x) -a| [F (x +a) —f (x)] — sin na da 
2sin > 


thf [f (x +a) — f (x)] cos na da 


taking advantage of the fact that sin(2n+ 1) $ = sin na cos Č 


2 
+cosnasin >. Break up the first of the integrals on the right 
of the latter equation into three integrals: 
1 ò cos $ 
satos] [F (x+a)—f (x)] q sin na da 

2 sin = 
~6 2 

-6 a 

1 cos > ; 
ty | etato] sin nada 
cs 2sin-> 
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n 


tall (xa) —F(x)] 


a 
cos 7 
a sin na da 


2 sin > 


n 
1 
++ [ [F (x+ a)— f (*)] x cos na da 
“x 
Put Q, (a) = Leto) Since f (x) is a bounded piecewise con- 
tinuous function, it follows that @,(a) is also a bounded and 
piecewise continuous periodic function of a. Hence, the latter inte- 


grał approaches zero as n—+oo, since it is a Fourier coefficient 
of this function. The function 


cos $ 
®, («) = [f (x +a) —-f (x)] ——Z 
sin > 
is bounded wnen —n <a <—ô and 5<a<n and 
1 
|®, (@)|<[M +M] — 
2sin > 


where M is the upper limit of the quantity |f (x)|. Also, the func- 

tion ®, (æ) is piecewise continuous. Hence, by formulas (5) of 

Sec. 5.7, the second and third integrals approach zero as n— oo. 
We can thus write 


ò cos Š 
lim [s, (x) —F ()] =lim + f fi wta) o] ? sinnada (1) 
nro n> 1o sin- 


In the expression on the right, the integration is performed over 
the interval —5<a<5; consequently, the integral is dependent 
on the values of the function f(x) only in the interval from x—ô 
to x+65. An important proposition thus follows from the last 
equation: the convergence of a Fourier series at a given point x 
depends only on the behaviour of the function f (x) in an arbitrarily 
small neighbourhood of this point. 

Therein lies the so-called principle of localization in the study 
of Fourier series. If two functions f,(x) and f,(x) coincide in the 
neighbourhood of some point x, then their Fourier series simulta- 
neously either converge or diverge at this point. 


5.10 CERTAIN SUFFICIENT CONDITIONS 
FOR THE CONVERGENCE OF A FOURIER SERIES 


In the preceding section it was shown that if a function f (x) 
is piecewise continuous in the interval [—x, x], then the conver- 
gence of a Fourier series at a given point x, to a value of the 
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function f(x,) depends on the behaviour of the function in a certain 
pein ited small neighbourhood [x,—6, x,+6] with centre at the 
point x,. 

Let us now prove that if in the neighbourhood of the point x, 
the function f(x) is such y 
that there exist finite limits 


lim Leta tee =k, (1) 
in Fota) —F (%o) _ 
T aE 
(2) To j 
while the function is con- Fig. 139 


tinuous at the very point 
x, (Fig. 139), then the Fourier series converges at this point to a 
corresponding value of the function F (x) *. 

Proof. Let us consider the function ®, (æ) defined in the prece- 
ding section: 


©, (= [f +a) e)l- am 
sin > 


since the function f(x) is piecewise continuous on the interval 
[—a, x] and is continuous at the point x,, it is therefore con- 
tinuous in some neighbourhood [x,—6, x,+6] of the point x,. 
For this reason, the function ®, (a) is continuous at all points where 
a0 and |a|<6. When a=Othefunction ®,(«) is not defined. 

Let us find lim Q, (a) and lim a, (a), making use of conditions (1; 


a-0-0 a 70+ 
and (2): 
a 
i : oe 
lim ®, (a) = lim [F (x, +a) —f (x,)] a 
a—-0-0 a +0-0 2sin 5 
z 

= lim frotal 2 agg % 

a>0-0 a Ste 2 
2 

a 
= lim tA o jin lim cos%=k,-1-1=h, 
a+0-0 % E 


a+0-0 sin a+0-0 


* If conditions (1) and (2) are fulfilled, then we say that the function f (x) 
has, at the point x, a derivative on the right and a derivative on the leit. 
Fig. 139 shows a function where kı=tan pi, kp=tan@e, ky Æ ka, If ky = kg, 
that is, if the derivatives on the right and left are equal, then the function wili 
be differentiable at the given point. 


23-—2082 
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Thus, if we redefine the function ®,(a) by putting ®, (0) = k, 
then it will be continuous on the interval [—6, 0], and, hence, 
bounded as well. Similarly we prove that 

lim Q, (a) =k, 
a+-0+0 

Consequently, the function ®,(a@) is bounded and continuous on 
the interval [0, 5]. Thus, on ‘the interval [—§, ô] the function 
@, (a) is bounded and piecewise continuous. Now let us return to 
equation (1), Sec. 5.9 eee x by x), 


sz 
à sin na da 


2sin > 
2 


lim [sn (x) —f (%)] = lim if [F(x +0)—F eal- 
or 
ô 
lim [s, (%) — f (%)] = lim L f Q, (a) sin na da 
n>a n>a z6 


From formulas (5) of Sec. 5.7 we conclude that the limit on the 
right is equal to zero, and therefore 


lim [sn (%)—f (x9)] =0 
OF nso 
lim s, (9) = f (%) 


The theorem is proved. 

This theorem differs from the theorem stated in Sec. 5.1 in that 
in the latter case it was required, for convergence of the Fourier 
series at a point x, to the value of the function f(x,), that the 
point x, should be a point of continuity on the interval [—zx, a], 
whereas the function should be piecewise monotonic; here, however, 
it is required that the function at the pcint x, should be a point 
of continuity and that the conditions (1) and (2) be fulfilled, while 
throughout the interval [—x, x] the function should be piecewise 
continuous and bounded. It is obvious that these conditions are 
different. 

Note 1. If a piecewise continuous function is differentiable at 
the point x,, it is obvious that conditions (1) and (2) are fulfilled. 
Here, k, =k,. Hence, at points where the function f(x) is differen- 
tiable, ‘the Fourier series converges to the value of the function 
at the corresponding point. 

Note 2. (a) The function considered in Example 2, Sec. 5.2 
(Fig. 127), satisfies conditions (1) and (2) at the points 0, + 2x, 
+ 4n,.... At all the other points it is differentiable. Consequently, 
a Fourier series constructed for it converges at each point to the 
value of this function. 
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(b) The function considered in Example 4, Sec. 5.2 (Fig. 130); 
satisfies conditions (1) and (2) at the points +n, +3n, +5x. It 
is differentiable at all the other points. It is represented by a 
Fourier series at each point. 

(c) The function considered in Example x Sec. 5.2 (Fig. 126), 
is discontinuous at the points +n, +37, +5n. At all other points 
it is differentiable. Hence, at all points, with the exception of 
points of discontinuity, the Fourier series corresponding to it con- 
verges to the value of the function at the corresponding points. 
At the discontinuities, the sum of the Fourier series is equal to 
the arithmetic mean limit of the function on the right and on the 
left (in this case, zero). 


5.11 PRACTICAL HARMONIC ANALYSIS 


The theory of expanding functions in Fourier series is called 
harmonic analysis. We shall now make several remarks about 
approximate computation of the coefficients of a Fourier series, 
that is to say, about practical harmonic analysis. 

As we know, the Fourier coefficients of a function f(x) with 
period 2x are defined by the formulas 


== | Fear, a= = § f(x) cos kx dx, 


n 
bk =1 f (x) sin kx dx 
-x 


In many practical cases, the function f(x) is represented either 
in tabular form (when the functional relation is obtained by 
experiment) or in the form of a curve which is plotted by some 
kind of instrument. In these cases the Fourier coefficients are 
calculated by means of approximate methods of integration (see 
Sec. 11.8, Vol. I). 

Let us consider the interval —n <x <x of length 2m. This 
can always be done by proper choice of scale on the x-axis. 

Divide the interval [—x, x] into n equal parts by the points 


=n = Kyn Nir Xar aap Apn 


Then the subinterval will be 


We denote the values of the function f(x) at the points x, x,, 
Xo, «+, Xp (respectively) by 


Yor Yi» Yar sees Yn 
23 * 
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These values are determined either from a table or from the graph 
of the given function (by measuring the corresponding ordinates). 

Then, taking advantage, for example, of the rectangular formula 
[see formula (1’), Sec. 11.8, Vol. I], we determine the Fourier 
coefficients: 


n n 
a, =“ Yi A= ay y;,coskx;, bp =—) Y; sin-kx; 
nin n izl n 


Diagrams have been devised that simplify computation of Fourier 
coefficients. We cannot deal here with the details but we can note 
that there are instruments (Fourier analyzers) which permit appro- 
e the values of Fourier coefficients from the graph of the 
function. 


5.12 THE FOURIER SERIES IN COMPLEX FORM 


Suppose we have a Fourier series for a periodic function f(x) 
with period 2x: 


Io=7+5 a, COS nx +6, sin nx (1) 
n=1 


We express cos nx and sinnx in terms of exponential functions 
[see formulas (3), Sec. 7.5, Vol. I]: 


ty -iy iy pa ty 
e e . etg 
cosy= +4, sin y = —5,—_ 
Thus, 
einx 1 e-inx x elnx —e-inx _ einx _ e~Inx 
cos nx = ——5——_ , sin nx = —-—— = — i —— 


Putting these values of cosnx and sinnx into formula (1) and 
performing appropriate manipulations, we get 


ao 
ins -inx inx — e~inx 
f@=S+ a7 pee 
1 


2 2 
na 
id . ib 
aa eer ae eins 4 Sali n er) (2) 
n= 
Introducing the notation 
Fmt, Pane, MG en (3) 


we see that (2) becomes 


F= x (cyei™® +-c_,e7!*) 
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This equation can be written more compactly as 


F= DY cei o (4) 


n=-@ 


that is the complex form of the Fourier series. 

Let us express the coefficients c, and c_, in terms of integrals. 
Using formulas (4), (5), and (6) of Sec. 5.1, we can write formu- 
las (3) as follows: 


=| f Fo cosnedr—i f f (x) sin rear | 
=x f f (x) (cosnx—i sin nx) dx = zx | F (x) e-inxdy 


Thus 
Ca= aq | Fede 6’) 


-x 


Similarly 
n 
1 H 
Cn = f f (x) et™dx (5") 
-x 


The expression for c, and formulas (5’) and (5”) can be combi- 
ned into a single formula 


au 
Ca =z | F(x edx (n=0, +1, +2, +3, ...) (6) 
-x 


C, and c_, are termed the complex Fourier coefficients of the fun- 
ction f (x). 

If the function f(x) is periodic with period 2l, then the Fourier 
series of f(x) will be 


Fe = y+ acos- +b, sin (7) 


[see formula (3), Sec. 5.5]. 
In this case, clearly, the Fourier series in complex form will te 
expressed by the formula 


i= eee" (8) 


n=- 2 


instead of formula (4). 
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The coefficients c, of the series are expressed by the formulas 
l (2r 
1 x 
may S fe T de (n=0, +1, +23.) ® 
-l 


The terminology in electrical and radio engineering is as follows: 


an 
the expressions Pa a are called harmonics, the numbers an= 
(n=0, +1, +2, ...) are called the wave numbers of the function 


f= DY e (10) 


n=—-@® 


The set of wave numbers forms what is known as a spectrum. 
Plotting these numbers on a number axis, we get a collection of 
separate points. This collection of points is called a discrete collec- 
tion, and the associated spectrum is termed a discrete spectrum. 
The coefficients c, defined by formulas (9) are called the complex 
amplitude. In some engineering texts, the collection of moduli of 
the amplitudes, |c, |, is also called the spectrum of the function f (x). 


5.13 FOURIER INTEGRAL 


Let a function f(x) be defined in an infinite interval (— o0, oo) 
and absolutely integrable over it; that is, there exists an integral 


Si@lé=a (1) 


Further, let the function f(x) be such that it is expandable into 
a Fourier series in any interval (—/, +1): 


f(x)= 2+ Sa, cos“ x 4b, sin “Fx (2) 
k=l 
where 


! l 
ar=7 È FO cos $ tdt, borf Osini rdt (3) 
=l 


Putting into series (2) the expressions of the coefficients a, and b, 
from formulas (3), we can write 


O=3r freoaryt l 2 J EO) cos FP tdt) cos Fx 
-ļ 


k=l 
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ES ( fiontar) ttx 


k=1 


l 6 I 
=; fi y Dd+7E po [cos $7 t cos “4 x4 sin T 7 sin “Pat 


or 
l œ l 
=} dt+} t) cos E24 
@=5 fro ba ies t. (4) 


Let us investigate what form expansion (4) will take when pas- 
sing to the limit as l — oo. 
We introduce the following notation: 


ST? e’ Op =o, <... and Aa, = 7 (5) 


Substituting into (4), we get 


I œ l 
f(x) = (roa +23 ( (Fa cosa (1—2) at) doy (6) 
-1 k=l \_] 


As l — oo, the first term on the right approaches zero. Indeed, 


L œ 
<x JliMldé < fIOld=7 +0 
-l -% 


l 
a iOa 
-1 


For any fixed /, the expression in the parentheses is a function 
of a, [see formulas (5)], which takes on values from 5 to œo. We 


will show, without proof, that if the function f(x) is piecewise 
monotonic on every finite interval, is bounded on an infinite in- 
terval and satisfies condition (1), then as /-+ +œ formula (6) 
takes the form 


ro=+i( | FO cosa — ndt )aa (7) 


The expression on the right is known as the Fourier integral of 
the function f(x). Equation (7) occurs for all points where the 
function is continuous. At points of discontinuity we have the 
equation 


ai Tao) cosa (t—x) dt ) drm C404 1E—9 7" 
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Let us transform the integral on the right of (7) by expanding 
cos a (ft —x): 


cos a (t —x) = cos at cos ax + sin at sin ax 


Putting this expression into formula (7) and taking cosax and 
sinax outside the integral signs, where the integration is perfor- 
med with respect to the variable ¢, we get 


rw=4Î( fio cos at at) cos ax da 
0 


1 © @ 
Fa ( j(t) sinat at) i d 8 
j 3 sin ax da (8) 


Each l the integrals in brackets with respect to ¢ exists, since 
the function f (f) is absolutely integrable in the interval (—oo, oo), 
and therefore the functions f(¢)cosat and f(t)sina? are also ab- 
solutely integrable. 

Let us consider particular cases of formula (8). 

1. Let f(x) be even. Then f(t) cosat is an even function, while 
f(t)sinat is odd and we have 


FFO cosatdt=2f f (f) cost dt 
0 


| F) sinat dt =0 


Formula (8) in this case takes the form 


F()= (f f(t) cosat at) cos a.x dat (9) 
0 *O 


2. Let f(x) be odd. Analyzing the character of the integrals in 
formula (8) in this case, we obtain 


lx) == (í f(t) sinat at) sin ax da (10) 
o ‘0 


If f(x) is defined only in the interval (0, œo), then tor x>0 it 
may be represented by either formula (9) or (10). In the first case 
we redefine it in the interval (—oo, 0) in even fashion; in the 
latter case, in odd fashion. 

Let it be noted once again that at the points of discontinuity 
one should write the following expression in place of f(x) in the 
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left-hand members of (9) and (10): 
f(x +0)-+f (x—0) 
2 


Let us return to formula (8). The integrals in brackets are func- 
tions of a. We introduce the following notation: 


A (a) =. FFO cos at dt 


ao 


B(a)=+ {FW sinat at 
Then formula (8) may be rewritten as follows: 


f(x) = | [A (@) cosax + B (a) sin ax] da (11) 
0 
We say that formula (11) yields an expansion of the function f (x) 
into harmonics with a frequency a that varies continuously from 
0 to oo. The law of distribution of amplitudes and initial phases 
as dependent upon the frequency @ is expressed in terms of the 
functions A (œ) and B (a). 
Let us return to formula (9). We set 


F(a)= y > (F(t) cosa dt (12) 
0 


then formula (9) takes the form 
iaz V 2 [F @)cos aux de (13) 
0 


The function F(a) is called the Fourier cosine transform of the 
function f (x). 

If in (12) we consider F(a) as given and f(t) as the unknown 
function, then it is an integral equation of the function f (t). Formula 
(13) gives the solution of this equation. 

On the basis of formula (10) we can write the following equations: 


© (a) = V2 fro sin at dt (14) 
0 


f()= V f (D (a) sin ax da (15) 


0 
The function ®(a) is called the Fourier sine transform. 
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Example. Let 
F= (BP >0, x>0) 
From (12) we determine the Fourier cosine transform: 


F (a) = Vi Z Jet osata => 2 ata 


From (14) we determine the Fourier sine transform: 


® (a) = om. ze t sin at dt = T T 


From formulas (13) and (15) we find the reciprocal relationships: 


o 
2 - 
FA papada me (0) 
0 
p . 
g) pipar de =e (x> 0) 


5.14 THE FOURIER INTEGRAL IN COMPLEX FORM 


In the Fourier integral prorauna (7), Sec. 5.12], the brackets 
contain an even function of a; hence, it is defined for negative 
values of a as well. On the basis of the foregoing, formula (7) can 
be rewritten as follows: 


œ 


fase §( [IO cosa (t—s) dt) de (1) 


-0 -0 


Let us now consider the following expression, which is identically 


equal to zero: 
M 


f (5 /(0) sina (t—2) dt )da=0 
-M\-o@ 

The expression on the left is identically equal to zero because 
the function of æ in the brackets is an odd function, and the in- 
tegral of an odd function from —M to +M is equal to zero. It 
is obvious that k 

lim f « WAG) sing (at) tao 
M0 4 \ 9. 
or 


f ( f F@sin a(t —x) at) da =0 (2) 


=- \-@ 
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Note. It is necessary to point to the following. A convergent 
integral with infinite limits is defined as follows: 


f e(a)da = f 9 (a)da+§ 9 (a) da 
c M 
=lim J pe ae Tn | q (a) da (3) 


er that each of the limits to the right exists (see Sec. 11.7, 
ol. I). But in equation (2) we mon 


f @ (a) da = lim fe (cx) da (x) 


-0 


Obviously, it may happen that the limit (#*) exists, while the 
limits on the right side of equation (x) do not exist. The expres- 
sion on the right of (+) is called the principal value of the in- 
tegral. Thus, in equation (2) we consider the principal value of 
the improper (outer) integral. The subsequent integrals of this sec- 
tion will be written in this sense. 


Let us multiply the terms of (2) by- and add them to the 
corresponding terms of (1); we then get 


f= | FFO (cosa (t—x)—i sina (t—x)) at Jax 


or 
hae Ne fro cian at |an (3) 


The right member in formula (3) is called the Fourier integral 
in complex form of the function f (x). 
Let us rewrite formula (3) thus: 


F= f E [iinet |e (4) 
or, compactly e ie 
(= fc (a) e!@* da (5) 


where 


Ca@=t f FA! at (6) 
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Formula (5) is similar to formula (10) of Sec. 5.12; œ is also 
called the wave number, but here it assumes all values from — oo 
to -+-oo and the spectrum of wave numbers is termed a continuous 
spectrum. There are other similarities between (5) and (10), Sec. 
5.12, whereas in formula (10) of Sec. 5.12 the wave number a, 
is associated with the complex amplitude c,, in formula (5) the 
wave numbers lying in interval («,, a@,-+-Aca) are associated with 
the complex amplitude C(a,). The function C (œ) is called the 
spectral density or the spectral function. (The term density is 
used here in same meaning as in Sec. 2.8, where we discussed the 
density of distribution over a two-dimensional domain.) 

Equation (4) is usually written as two equations: 


F*(a)= ar { Fe dt (7) 
Fe) =e |E eda (8) 


-0 


The function F* (a) defined by formula (7) is called the Fourier 
transform of the function f(x). The function f(x) defined by for- 
mula (8) is called the inverse Fourier transform of the function 
F*(a) (the transforms differ in the sign in front of i). The func- 
tion F*(a) differs from the function C (a) by the constant factor 

1 


27 

From the transformations (7) and (8) follow the transformations 
(12), (14), (13) and (15), Sec. 5.13 (to within the constant fac- 
tor 1/2). The transformations (12) and (14) are obtained if we 
substitute into (7) 

e-iat —cosat—isinat, F*(a)=F (a)—i® (a) 

and equate the real and imaginary parts. In similar fashion it is 
possible to obtain transformations (13) and (15) from the trans- 
formation (8). 

Note that in Chapter 7 (“Operational Calculus and Certain of 


Its Applications”) we will make use of transformations that are 
similar to the Fourier transformations. 


5.15 FOURIER SERIES EXPANSION WITH RESPECT 
TO AN ORTHOGONAL SYSTEM OF FUNCTIONS 


Definition 1. An infinite sequence (system) of functions 


P Pa (Xs +--+ Pa (Xs «+> (1) 
is said to be orthogonal on the interval [a, b] if for any nk 
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the equation 


(% () Pa (x) dx= 0 (2) 
holds true. It is e here that 
f Ep, edr a0 
Example 1. The system of functions 
1, cosx, sin x, cos 2x, sin 2x, ..., cos nx, sin nx, ... (3) 


is orthogonal on the interval [— x, a]. This follows from the equations (I) and 
(1I) of Sec. 5.1. 
Example 2. The system of functions 
1, cos Č x, sin x, cos 2% x, sin 27x, aiy cos = sin AA Soi (3’) 
l l L l l l 
is orthogonal on the interval {—J, 1]. This can readily be verified. 
Example 3. The system of functions 
1, cosx, cos 2x, cos 3x, ..., COS NX, ... (4) 
is orthogonal on the interval (0, x]. 
Example 4. The system of functions 
sin x. sin2x, ..., SİN NV, ... (5) 
is orthogonal on the interval [0, x]. 

Below we give other systems of orthogonal functions. 

Suppose a function f(x), defined on the interval [a, b], is such 
that it can be represented by a series relative to the functions of 
the orthogonal system (1), which converges to the given function 
on [a, b]: 

ao 
f(x) = D Cna (*) (6) 
n=0 
We determine the coefficients c,. Suppose that the series obtained 
by multiplying the series (6) by any function , (x) admits term- 
wise integration. 


We multiply both members of (6) by ọ,(x) and integrate from 
a to b. Taking into account equation (2), we ge 


b b 
f F) pa (x) dx= c, | q (x) dx 
whence ° i 
b 
f Fe) prle de 


== (7) 
{ opde 
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The coefficients c, computed from formulas (7) are called the Fou- 
rier coefficients of the function f (x) relative to the system of ortho- 
gonal functions (1). Series (6) is called the Fourier series relative 
to the system of functions (1). 

Definition 2. The orthogonal system of functions 


Pi (x), Pe(X), <--> Pa (X), 


is called a complete system if for any quadratically integrable 
function f(x), that is, such that 


b 
| f(x)dx < œ 
the following equation holds true: 
2 
tim | i (x) — 2 CP; 09 | dx =0 (8) 


By virtue of the definitions of Sec. 5.7, equation (8) may also 
be interpreted as follows. The root-mean-square deviation of the 


sum Dew (x) from the function f(x) tends to zero as n— oo. 


If equation (8) holds, then we say that the Fourier series (6) 
converges to the function f (x) in the mean. 

It is quite obvious that convergence in the mean does not imply 
convergence at every point of the interval [a, b]. 

We note without proof that the trigonometric systems indicated 
in examples 1 to 4 are complete over the appropriate intervals. 

Extensive use is made of the system of Bessel functions 


Jn (Aix), Jy (hex), «+, J, (AX), ... (9) 
which were considered in Sec. 4.23. Here, Aa, Aos +++, Ay, +. are 
the roots of the Bessel function, that is, numbers such that satisfy 


the relation 
JnQjQ=0 (i=1, 2, ...) 


We will now point out, without proof, that the system of func- 
tions 


Vx Jalat), VX Jaak), coe, We Jali) vee (10) 


5.16 The Concept of a Linear Function Space 367 


is orthogonal on the interval [0, 1]: 


1 
{ aJn (hex) Jn (yx) dx = 0* , (k> j) (11) 
0 


Systems of orthogonal Legendre polynomials also find applications. 
They are defined as follows: 


1 d®T(x2—1)n 
Py(x)=1, Py (t)= yep SS" (n= 1, 2, ...) 


They satisfy the equations 
(x?— 1) y" + 2xy’ —n (n+ 1l)y=0 
Other systems of orthogonal polynomials are also used. 


5.16 THE CONCEPT OF A LINEAR FUNCTION SPACE. 
EXPANSION OF FUNCTIONS IN FOURIER 
SERIES COMPARED WITH DECOMPOSITION OF VECTORS 


In analytic geometry, a vector in three-dimensional space is 
defined as 
A=A,i+A,j+ Ak 


where i, j, k are unit, mutually perpendicular vectors taken along 
the coordinate axes. The vectors i, J, k will from now on be de- 
noted by @,, @,, ĉe. 

In similar fashion we can define a vector in n-dimensional space: 


n 
A= Ae; 
t=1 
A set of vectors of the form A will be called an n-dimensional 
Euclidean space and will be symbolized by £,. The vectors A will 
be called the elements or points of the n-dimensional Euclidean 
space. (It is also possible to consider vectors in an infinite-dimen- 


sional space.) Let us examine the properties of the space E,. 
Suppose we have two vectors in the space E,,: 


n n 
A= 4 A,e; and B= 2 Be; 


* If for the functions g, (x), y (x) the relation 
b 
[eee g(x) dx=0 (jh 
a 


holds, then we say that the functions @;(x) are orthogonal with weight p (x). 
Hence, the functions Jẹ (A,;x) (for k # j) are orthogonal with weight x. 
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If C, and C, are real numbers, then by analogy with three-dimen- 
sional space 
C,A+C,B (1) 
is a vector in E,,. 
The scalar product (also called dot product or inner product) of 
two vectors A and B is given by the expression 


n 
(AB) = 2 A;B; (2) 
The vectors @,, €, ..., @, lie in the space E, and formula (2) 


holds true. 
Hence we get 


(ee)=0 (ij) (2’) 
and 
(ee)=1 (i=j) 
Vectors whose scalar product is equal to zero are called ortho- 
gonal. vectors. Consequently, the vectors @,, @,, ..., €„ are ortho- 
gonal. 


As in the case of three-dimensional space, we can easily es- 
tablish the following properties of a scalar product: 
(AB) = (BA) 
(A+B, C)=(AC) + (BC) 
(4A, B)=1\ (AB) 


The length or modulus of a vector A is defined as in three-di- 
mensional space: 


(3) 


A-VA} $a a) 


The length of the difference between two vectors is defined na- 


turally as follows: 
|A—Bl=Y X (4—8 6) 


In particular, 


= TAT (6) 
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Let us consider the collection of all piecewise monotonic bounded 
functions on the interval [a, b].* We denote this collection by ® 
and call it the space of functions ®. The functions of this space will 
be called elements or points of the space*®@. It is possible to es- 
tablish operations on the functions of the space ® that are similar 
to the operations we performed on the vectors of the space E,,. 

If C, and C, are any real numbers and f, (x), f,(x) are elements 


of the space @, then 
Cif, (x) + Cf: (x) (7) 
is an element of ®. 
If f(x) and g(x) are two functions in ®, then the scalar product 
of the functions f(x) and p(x) is given by the expression 


b 


(F, p) = | Fœ) (a) dx (8) 


a 


This expression is similar to expression (2). It is easy to verify 
that the scalar product (8) has properties similar to the properties (3) 


for vectors: 
F, p)=(p, f) 
(ithe P)= (fo P)+ (Cf p) | 
(Af, p)=A(f, p) 


Like the definition of the modulus of a vector by formula (4), 
we have the so-called norm of an element f(x) of the space ®: 


sae 
WI=VEH=)V (rear (10 


a 


(9) 


The distance between elements f(x) and ọ (x) of space @ is defined 
by the expression 


eee 
liol- SFO] (11) 


which is similar to formula (5). 

Expression (11), which gives the distance between elements of 
the space, is called the metric of the space. To within the factor 
V b—a, it coincides with the root-mean-square deviation 6 defined 
in Sec. 5.7. 


* A class of functions of this kind is considered in the theorem of Sec. 5.1. 
We could also consider a broader class of functions for which all the assertions 
of Sec. 5.1 are preserved. 


24— 2082 
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Clearly, if f (x)= q(x), that is, f(x) and ọ (x) coincide at all 
points of the interval [a, b], then ||f—q||=0. But if ||f—@||=0, 
then f (x)= (x) at all, except a finite number, points of [a, 6].* 
But in this case we also say that the elements of the space ® are 
identical. 

A space of piecewise monotonic bounded functions, in which are 
defined the operations (7), (8) and the metric is given by equ- 
ation (11), is called a linear function space with quadratic metric. 
The elements of the space ® are called points of the space or vectors. 

Now let us consider a sequence of functions 


Pı (x), P: (x), sooo Dy (x), eee (12) 
lying in the space ®. 
The sequence of functions (12) is said to be orthogonal on the 
interval [a, b] if for arbitrary i, j (i Aj) the equations 
b 
(Pr P= f p: (x) p; (2) dx=0 (13) 


hold true. 
On the basis of equations (I), Sec. 5.1, it follows that, for instance, 
the system of functions 


1, cosx, sinx, cos2x, sin2x, cos3x, sin3x, ... 
is orthogonal on the interval [—x, x]. 

We will now show that expanding a function in a Fourier series 
of orthogonal functions is similar to the decomposition of a vector 
into orthogonal vectors. Suppose we have a vector 

A=A,e,+A,e,+...+A,@,+..-+A,€, (14) 

We assume that the vectors e,, €, ..., €, are orthogonal, that is, 
if ij, then 

(e,e;)=0 (15) 

To determine the projection A,, we form the scalar products of 
each member of (14) by the vector e,. By properties (2) and (3) 
we get 

(Ae,) = A, (€,€g) + Az (€2€,) +. +» + Ag (Cpe) +++» + An (ener) 
Taking account of (15) we obtain 

(Ae,) = Ag (exe) 
whence 
A, =C (k=1, 2, ..., n) (16) 


(eker) 


* There can also be an infinite number of points, where f (x) 4 ọ (x). 
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Further assume that the function f(x) has been expanded relative 
to a system of orthogonal functions: 


Fx) = ange (9 (17) 
Forming scalar products of each member of (17) by 9, (x) and 
taking into account (9) and (13), we get* 
(F, Pr) =ar (Par Px) 
whence 
fioros 
a ee cai (18) 
È Ue (1? ae 
a 


(F, Pe) 


On = (Pe Pr) 


Formula (18) is similar to formula (16). 


Now set 
s= Š ap, (2) (19) 
i ae | (2=1, 2, ...) (20) 
Lo 


then the system of orthogonal functions (12) is complete on the 
interval [a, b]. 
The Fourier series (17) converges to the function f (x) in the mean. 


Exercises on Chapter 5 
1. Expand the following function in a Fourier series in the interval (— n, 7): 


f (x) = 2x for OKs 
f(x)=x for —n<xeq@0 


Ans. gene (St. Too $in 2x 


52 2 
sin 3x _ 
qi a) 


2. Taking advantage of the expansion of the function f (x)= 1 in m interval 
(0, m)in the sines of multiple arcs, calculate the sum of the series 1=5+5- 


* We presume that the series obtained in the process converge and that 
term-by-term integration is legitimate. 
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3. Utilizing the expansion of the function f(x)=x? in a Fourier series, 


2 
compute the sum of the series a-ptg-gt . Ans. >: 


2 
4. Expand the function f= in a Fourier series in the interval 
cos 2x , cos 3x cos 4x 
(— ax, z). Ans. cos x——z tg ee x 


5. Expand the following function in a Fourier series in the interval (— x, 7) 


į (x)= A for —n «x <0 


Fx) = (m—2) for Omx<n 


Ans. sin xt} sin 2x +4 sin 3x+.. 
6. Expand in a Fourier series, in the interval (— n, 2), the function 
f(x)=—x for —n<xq0 


f(xy)=0 for O<xacn 
Ake 2S 2 2 Emene Sey nee : 
n=l 


7. ity in a Fourier series, in the interval (— n, x), the function 
f(x)=1 for —n <x<0 
f(x)=—2 for O<xaan 


sin sin (2n+1)x 
Ans. -3-25 Eu o 


8. Expand the funln f (x)=x?, in the interval (0, x), in a series of sines. 


Ais: 2S (ye {24S ne 1 } sin 


9. Expand the function y= cos 2x in a series of sines in the interval (0, 2). 
4 f sinx , 3sin3x , Ssin5x 
Ans: = iji tey tagt E 
10. pues the function y=sinx in a series of cosines in the interval (0, x). 
cos 2x , cos 4x 
As: iltea tHep t .|. 
11. Expand the function y=e* in a Fourier series in the interval (—J, J). 
2 (—!)” sin 27 


aoe l 
Ans. +1 (ei — > oa 


æ (—1)"-! nsin = 


+n (e!-—e-!) pa ja a 


12. Expand the function f (x)= 2x in a series of snes in the interval (0, 1). 
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Ans. i (= pna SLATE, 


13. Expand the function f(x)=x in a series of sines Nin the interval (0, 2). 
ATX 


sin at, 


Ans. D (=r — 
14. Bpm the function 
r=] x fr0<xal 
= \2—x frl<x<2 


in the interval (0, 2): (a) in a series of sines; (b) in a series of cosines. 
ñ (2n + 1) ax 


8 S 2 
Ans. (a) >> (—)"—aaaye > 


n=0 
l 4 = cos (2n + 1) mx 
r a2 np 


CHAPTER 6 


EQUATIONS OF MATHEMATICAL PHYSICS 


6.1 BASIC TYPES OF EQUATIONS OF MATHEMATICAL PHYSICS 


The basic equations of mathematical physics (for the case of 
functions of two independent variables) are the following second- 
order partial differential equations. 

I. Wave equation: 


af? gE (1) 


This equation is invoked in the study of processes of transversal 
vibrations of a string, the longitudinal vibrations of rods, electric 
oscillations in wires, the torsional oscillations of shafts, oscillations 
in gases and so forth. This equation is the simplest of the class of 
equations of hyperbolic type. 

Il. Fourier equation for heat conduction: 


Ot Ox (2) 


This equation is invoked in the study of processes of the propa- 
gation of heat, the filtration of liquids and gases in a porous 
medium (for example, the filtration of oil and gas in subterranean 
sandstones), some problems in probability theory, etc. This equation 
is the simplest of the class of equations of parabolic type. 

HI. Laplace equation: 


au , a 
Jata? (3) 


This equation is invoked in the study of problems dealing with 
electric and magnetic fields, stationary thermal state, problems in 
hydrodynamics, diffusion, and so on. This equation is the simplest 
in the class of equations of elliptic type. 

In equations (1), (2), and (3), the unknown function u depends 
on two variables. Also considered are appropriate equations of 
functions with a larger number of variables. Thus, the wave 
equation in three independent variables is of the form 


ðe ðu ð? ; 
a=? (Sats) (1’) 
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the heat-conduction equation in three independent variables is of 
the form a PE 
g-e (a e 
the Laplace equation in three independent variables has the form 
u , ðu , Ou 


aaa t aya t age = 9 (3’) 


6.2 DERIVING THE EQUATION OF THE VIBRATING STRING. 
FORMULATING THE BOUNDARY-VALUE PROBLEM. 
DERIVING EQUATIONS OF ELECTRIC OSCILLATIONS IN WIRES 


In mathematical physics a string is understood to be a flexible 
and elastic thread. The tensions that arise in a string at any 
instant of time are directed along a tangent to its profile. Let a 
string of length / be, at the initial instant, directed along a seg- 
ment of the x-axis from 0 to /. Assume 
that the ends of the string are fixed 
at the points x=0 and x=l. If the 
string is deflected from its original po- 
sition and then let loose; or if without 
deflecting the string we impart to its 
points acertain velocity at the initial time, Fig. 140 
or if we deflect the string and impart a 
velocity toits points, then the points of the string will perform 
certain motions; we say that the string is set into vibration. The 
problem is to determine the shape of the string at any instant 
of time and to determine the law of motion of every point of the 
string as a function of time. 

Let us consider small deflections of the points of the string from 
the initial position. We may suppose that the motion of the points 
of the string is perpendicular to the x-axis and in a single plane. 
On this assumption, the process of vibration of the string is 
described by a single function u(x, t), which yields the amount 
that a point of the string with abscissa x has moved at time ¢ 
(Fig. 140). 

Since we consider small deflections of the string in the xu- 
plane, we shall assume that the length of an element of string 
Ù M,M, is equal to its projection on the x-axis, that is,* vM,M,= 


i “i aus assumption is equivalent to neglecting uy as compared with 1. 
ndeed, 


Xs Xs Xs 
YMM = | Viturer=J(ittuy—... ae z% |a= 
Xi Est ži 
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=x,—X,. We also assume that the tension of the string at all 
points is the same; we denote it by T. 

Consider an element of the string MM’ (Fig. 141). Forces T 
act at the ends of this element along tangents to the string. Let 
the tangents form with the x-axis 
angles ọ and g+Ag. Then the 
projection on the u-axis of forces 
acting on the element MM’ will 
be equal to T sin (p+ Ag)—T sing. 
T+T Since the angle ọ is small, we can 
Fig. 141 put tang ~ sing, and we will have 


T sin (g+ Ag)—T sing 
æT tan(p+Aqg)—T tang=T [* oe t) du E D] 


ð?u (x ~- 0Ax, 1) ~ r u (x, t) 
-a Ax = T a, Ax 


T 


=T 
0<0<1 


(here, we applied the Lagrange theorem to the expression in the 
square brackets). 

In order to obtain the equation of motion, we must equate to 
the force of inertia the external forces applied to the element. 
Let p be the linear density of the string. Then the mass of an 
element of string will be pAx. The acceleration of the element 


is a Hence, by d’Alembert’s principle we will have 


ĝu 8u 
pAx ae =T Ja Ax 


Cancelling out Ax and denoting Tse, we get the equation of 


motion: 
u du 


JE Coa (1) 


This is the wave equation, the equation of the vibrating string. 
Equation (1) by itself is not sufficient for a complete definition 
of the motion of a string. The desired function u(x, ¢) must also 
satisfy boundary conditions that indicate what occurs at the ends 
of the string (x=0 and x=1) and initial conditions, which describe 
the state of the string at the initial time (¢=0). The boundary 
and initial conditions are referred to collectively as boundary-value 
conditions. 

For example, as we assumed, let the ends of the string at x=0 
and x=} be fixed. Then for any ¢ the following equations must 
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hold: 
u (0, 7)=0 (2) 
u(l, t)=0 œ (2’) 


These equations are the boundary conditions for our problem. 
At ¢=0 the string has a definite shape, that which we gave it. 
Let this shape be defined by a function f(x). We should then 


have 
u (x, 0) =u |tz = f (x) (3) 


Furthermore, at the initial instant the velocity at each point 
of the string must be given; it is defined by the function ọ (x). 
Thus, we should have 


el, =P) (3) 


The conditions (3) and ae are ae initial conditions. 

Note. For a special case we may have f(x)=0 or (x) =0. 
But if f(x)=0 and g(x)=0, then the string will be in a state 
of rest; hence, u(x, t) = 

As has already been pointed out, the problem of electric oscil- 
lations in wires likewise leads to equation (1). Let us show this 
to be the case. The electric current in a wire is characterized by 
the quantity i(x, £t) and the voltage v(x, t) which are dependent 
on the coordinate x of a point of the wire and on the time ¢. 
Regarding an element of wire Ax, we can write that the voltage 
drop on the element Ax is equal to v(x, t)—vu(x+Ax, t) % 


w? Ax. This voltage drop consists of the resistance drop, equal 
to iRAx, and the inductive drop, equal to Z LAL. Thus, 

= 2 Ax=iRAx+S LAx (4) 
where R and L are the resistance and the inductance reckoned per 
unit length of wire. The minus sign indicates that the current 


flow is in a direction opposite to the build-up of v. Cancelling 
out Ax, we get the equation 


æ LiR+L2=0 (5) 


Further, the difference between the current leaving element Ax 
and entering it during time At will be 


li (x, H —i (x+ Ax, )] At~—S Ax At 
It is taken up in charging the element (this is equal to CAx =| F At) 
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and in leakage through the lateral surface of the wire due to 
imperfect insulation, equal to AvAxAt (here A is the leakage 
coefficient). Equating these expressions and cancelling out AxAt, 
we get the equation 


ði ð 
+C +Av=0 (6) 


Equations (5) and (6) are generally called telegraph equations. 
From the system of equations (5) and (6) we can obtain an 
equation that contains only the desired function i(x, t), and an 
equation containing only the desired function v (x, t). Differentiate 
the terms of equation (6) with respect to x; differentiate the terms 
of (5) with respect to ¢ and multiply them by C. Subtracting, 
we get 
ĝi 
ot 
Substituting into this equation the expression > from (5), we get 


gi š ði ði ĝi 
Tip (—iR—L $ )— CRE cL Fy =0 


z 
Zi 4 Ae crA—cr 4 -0 


ot? 
or 
Oi ĝ?i ði ; 
za = CL Sa + (CR+ AL) 5+ ARi (7) 
Similarly, we obtain an equation for determining v(x, t): 
ð? ð? ð 
Sgt = CL 5px + (CR + AL) G + ARo (8) 


If we neglect the leakage through the insulation (A= 0) and 
the resistance (R=0), then equations (7) and (8) pass into the 
wave equations 

ði Ot DD 


ek aa k: LEN 
Cot oF? O ot = oF 


where a=. The physical conditions dictate the formulation of 
the boundary and initial conditions of the problem. 


6.3 SOLUTION OF THE EQUATION OF THE VIBRATING 
STRING BY THE METHOD OF SEPARATION OF VARIABLES 
(THE FOURIER METHOD) 


The method of separation of variables (or the Fourier method), 
which we shall now discuss, is typical of the solution of many 
problems in mathematical physics. Let it be required to find the 
solution of the equation 

ð? ð? 
5 =O 558 (1) 


6.3 Solution of the Equation of the Vibrating String 379 


which satisfies the boundary-value conditions 


u (0, t)=0 (2) 
u(l, t)=0 ° (3) 
u(x, 0) =f (x) (4) 
eT] =) (5) 


We shall seek a particular solution (not identically equal to zero) 
of equation (1) that satisfies the boundary conditions (2) and (3), 
in the form of a product of two functions X (x) and T (t), of 
which the former is dependent only on x, and the latter, only 
on f: 
u(x, t)=X (x)T (t) (6) 

Substituting into equation (1), we get X (x) T” ae (x) T (2), 
and dividing the terms of the equation by a?X 

T” x” 

TK (7) 


The left member of this equation is a function that does not 
depend on x, the right member is a function that does not depend 
on £. Equation (7) is possible only when the left and right mem- 
bers are not dependent either on x or on ¢, that is, are equal to 
a constant number. We denote it by —A, where à >0 (later on 
we will consider the case 4 < 0). Thus, 


r= % SEA 
From these equations we get two equations: 
X"+AX =0 (8) 
T"+aAT =0 (9) 
The general solutions of these equations are (see Sec. 1.21): 
X (x) = A cos V àx + B sin V dx (10) 
T (t)=C cosa V Mt +D sin aV àt (11) 


where A, B, C and D are arbitrary constants. 
Substituting the expressions X (x) and T (t) into (6), we get 


u(x, t)=(AcosV Ax +B sin V Ax) (CcosaV M +D sina V t) 


Now choose the constants A and B so that the conditions (2) and 
(3) are satisfied. Since T (t) Æ 0 [otherwise we would have u (x, t)=0, 
which contradicts the hypothesis], the function X (x) must satisfy 
the conditions (2) and (3); that is, we must have X (0)=0, X (l) =0. 
Putting the values x=0 and x=/ into (10), we obtain, on the 
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basis of (2) and (3), 
0=A-1+B-0 
0=AcosVAl+BsinV Al 
From the first equation we find A=0. From the second it follows 
that 
BsinV 1=0 
B0, since otherwise we would have X=0 and u=0, which 
contradicts the hypothesis. Consequently, we must have 
sinV Al=0 
whence 
Vi= = (n=l, 2, ...) (12) 


(we do not take the value n=O, since then we would have X=0 
and u=0). And so we have 


X=Bsin*x (13) 


These values of A are called eigenvalues of the given boundary- 
value problem. The functions X (x) corresponding to them are 
called eigenfunctions. 

Note. If in place of —A we took the expression +A=&?, then 
equation (8) would take the form 


X"—kR?X=0 
The general solution of this equation is 
X = Ae** -+ Be~** 
A nonzero solution in this form cannot satisfy the boundary con- 
ditions (2) and (3). 
Knowing Vi we can [utilizing (11)] write 


T (t)=Ccos™*t4+Dsin“*t¢ (n=1,2,...) (14) 


For each value of n, hence for every A, we put the expressions 
(13) and (14) into (6) and obtain a solution of equation (1) that 
satisfies the boundary conditions (2) and (3). We denote this solu- 
tion by uw, (x, t): 


ü, (x, N= sin x (C, cos T t+ Dp sin 2t) (15) 
For each value of n we can take the constants C and D and thus 


write C, and D, (the constant B is included in C, and D,). Since 
equation (1) is linear and homogeneous, the sum of the solutions 
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is also a solution, and therefore the function represented by the 
series 


u(x, t) -f u, (x, t) 


or 


œ 


da mr . NT 

u (x, N= (Cn cos —= t + D,„ sin —— t) sin T* (16) 

will likewise be a solution of the differential equation (1), which 

will satisfy the boundary conditions (2) and (3). Series (16) will 

obviously be a solution of equation (1) only if the coefficients C, 

and D, are such that this series converges and that the series 

resulting from a double term-by-term differentiation with respect 
to x and to ¢ converge as well. 

The solution (16) should also satisfy the initial conditions (4) 

and (5). We shall try to do this by choosing the constants C, 

and D,. Substituting into (16) ¢=0, we get [see condition (4)]: 


Oe>> C, sin x (17) 
n=l 


If the function f(x) is such that in the interval (0, /) it may be 
expanded in a Fourier series (see Sec. 5.1), the condition (17) will 
be fulfilled if we put 

l 


C, =4 ff sin T x dx (18) 
ö 


We then differentiate the terms of (16) with respect to £ and 
substitute ¢=0. From condition (5) we get the equation 


(x)= È D, = — sin nx 
We define the Fourier coetcient of this series: 
D, “ad ly (x) sin x dx 
or 
; l 
D =z f 9 (x) sin xdr (19) 
0 


Thus, we have proved that the series (16), where the coefficients 
C, and D, are defined by formulas (18) and (19) [if it admits 
double termwise differentiation], is a function ae t), which is 
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the solution of equation (1) and satisfies the boundary and initial 
conditions (2) to (5). 

Note. Solving the problem at hand for the wave equation by 
a different method, we can prove that the series (16) is a solution 
even when it does not admit termwise differentiation. In this case 
the function f(x) must be twice differentiable and p(x) must be 
once differentiable.* 


6.4 THE EQUATION OF HEAT CONDUCTION IN A ROD. 
FORMULATION OF THE BOUNDARY-VALUE PROBLEM 


Let us consider a homogeneous rod of length l. We assume 
that the lateral surface of the rod is impenetrable to heat transfer 
and that the temperature is the same at all points of any cross- 

sectional area of the rod. Let us study 

the process of propagation of heat in the 

0 X, T l rod. 

We place the x-axis so that one end 

Fig. 142 of the rod coincides with the point 

x=0, the other with the point x=I 

(Fig. 142). Let u(x,t) be the temperature in the cross section 

of the rod with abscissa x at time ¢. Experiment tells us that the 

rate of propagation of heat (that is, the quantity of heat passing 

through a cross section with abscissa x in unit time) is given by 
the formula 


Ou 
q=—keS (1) 


where S is the cross-sectional area of the rod and & is the coefficient 
of thermal conductivity. ** 

Let us examine an element of rod contained between cross 
sections with abscissas x, and x, (x,—x,= Ax). The quantity of 
heat passing through the cross section with abscissa x, during 
time At will be equal to 


AQ,=—k==| SAt (2) 


* These conditions are dealt with in detail in Equations of Mathematical 
Physics by A. N. Tikhonov and A. A. Samarsky, Gostekhizdat, 1954 (in 
Russian). 

** The rate of heat transfer, or the rate of heat flux, is determined by 


AQ 
q= lim a 
At > 0 


where AQ is the quantity of heat that has passed through a cross section S 
during a time Af. 
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and the same for the cross section with abscissa x,: 


AQ =—kS4| SAt (3) 


X=X: è 


The influx of heat AQ,—AQ, into the rod element during time 
At will be 


AQ,—AQ, = | 32 


sat] = S 


sat] 


Ou 


(we applied the Lagrange theorem to the difference oe 


x=% X=Xs 


Ox 
on ). This influx of heat during time At was spent in 
raising the temperature of the rod element by Au: 


AQ, — AQ, = cpAxSAu 


X=Xq 


or 
AQ, — AQ, ~ cpAxS At (5) 


where c is the heat capacity of the substance of the rod and p 
is the density of the substance (eAxS is the mass of an element 
of rod). 

Equating expressions (4) and (5) of one and the same quantity 
of heat AQ,—AQ,, we get 

0? ð 
k Sgr AxSAt = cpAxS 5p At 

or 


ðu _ k u 
Ot cp xT 
Denoting Aaa’, we finally get 
ðu 8u 
a" oe (6) 


This is the equation for the propagation of heat (the equation of 
heat conduction) in a homogeneous rod. 

For the solution of equation (6) to be definite, the function u (x, t) 
must satisfy the boundary-value conditions corresponding to the 
physical conditions of the problem. For the solution of equation (6), 
the boundary-value conditions may differ. The conditions which 
correspond to the so-called first boundary-value problem for 0< t <T 


are as follows: 
u(x, 0)=@ (x) (7) 
u(0, t)=, (£) (8) 
u(l, t) =, (t) (9) 
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Physically, condition (7) (the initial condition) corresponds to 
the fact that for ¢=0 a temperature is given in various cross 
sections of the rod equal to (x). Conditions (8) and (9) (the 
boundary conditions) correspond to the fact that at the ends of 
the rod, x=0 and x=/, a temperature is maintained equal to 
p, (£) and 1p, (¢), respectively. 

It is proved that the equation (6) has only one solution in the 
See eee 0<t<T, which satisfies the conditions (7), (8), 
and (9). 


6.5 HEAT TRANSFER IN SPACE 


Let us further consider the process of heat transfer in three-di- 
mensional space. Let u(x, y, z, t) be the temperature at a point 
with coordinates (x, y, z) at time ¢. Experiment states that the 
rate of heat passage through an area As, that is, the amount of 
heat passing through in unit time is governed by the formula [si- 
milar to formula (1) of the preceding section] 


AQ =— kË As (1) 


where k is the coefficient of thermal conductivity of the medium 
under consideration, which we regard as homogeneous and isotro- 
pic, # is the unit vector directed normally to the area As in the 
direction of flow of the heat. Taking advantage of Sec. 8.14, Vol. I, 
we can write 


ðu ðu ðu ðu 
Jn = gg (OSH tag cos ĝ +3; cos 
where cosa, cosB, cosyare the direction cosines of the vector n, or 
ðu 
g ngadu 


Substituting the expression a into formula (1), we get 


AQ =— kn grad u As 


The amount of heat flowing in time At through the elementary 
area As will be 
AQ At = — kn grad u At As 


Now let us return to the problem posed at the beginning of 
the section. In the medium at hand we pick out a small volume V 
bounded by the surface S. The amount of heat flowing through 
the surface S will be 


Q=—At jS kn grad u ds (2) 
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where n is the unit vector directed along the external normal to 
the surface S. It is obvious that formula (2) yields the amount of 
heat entering the volume V (or leaving the volume V) during 
time At. The amount of heat entering-V is spent in raising the 
temperature of the substance of this volume. 

Let us consider an elementary volume Av. Let its temperature 
rise by Au in time At. Obviously, the amount of heat expended 
on raising the temperature of the element Av will be 


chup Au = cAup 5 a At 


where c is the heat capacity of the substance and p is the density. 
The total amount of heat consumed in raising the temperature in 
the volume V during time At will = 


At {es cP a 4 dv 


But this is the heat that has entered the volume V during the 
time At; it is defined by formula (2). Thus, we have the equation 


—At 1 kn grad uds = At fes 5 = do 


Cancelling out Af, we get 
= kn grad uds= iS Cp a “du (3) 


The surface integral on the left-hand side of this equation we 
transform by the Ostrogradsky formula (see Sec. 3.8), assuming 
F=kgrad u: 


(g (k grad u) n ds = {f div (k grad u) do 
S ý 


Replacing the double integral on the left of (3) by.a triple inte- 


gral, we get 
_—[fferwaatan aon fijada 


eef [aiv (k grad u) -+ cp al dv =0 (4) 
V 


Applying the mean-value theorem to the triple integral on the left 
(see Sec. 2.12), we get 


|div (k grad u) + €p + =0 (5) 


XEN, V=, Z=2, 


or 


where the point P(x,, Yı, z,) is some point in the volume V. 


25—2082 
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Since we can pick out an arbitrary volume V in three-dimen- 
sional space where heat is being transferred, and since we assume 
that the integrand in (4) is continuous, (5) will hold true at each 
point of the space. Thus, 

cp SH = — div (k grad u) (6) 
But 
“Ou 


kgradu=k EI+ k EHk IER 


and (see Sec. 3.8) 
div (k gradu) =} (k we) te (ge) ta (#55) 


Ox. 

Substituting into (6), we obtain 
Ou ð ðu ð ðu ô ðu 
Swa a wta a) aa) (9 
If k is a constant, then 
div (k grad u) = k div (grad n =k (Set Sta) 
and equation (6) then yields 
Ou ðu , eu , du 
—0 a =t Gat Gat ar) 


or, putting —* =, 


Ou Ou , Au , uy 
r=" (gat get oa) (8) 
Equation (8) is compactly written as 
>< =Q0 Au 


where u= eta + = is the Laplacian operator. Equation (8) 


is the equation of heat conduction in space. To find its unique 
solution that corresponds to the problem posed here, it is necessary 
to specify the boundary-value conditions. 

Let there be a body Q with a surface o. In this body we con- 
sider the process of heat transfer. At the initial time the tempe- 
rature of the body is specified, which means that the solution is 
known for ¢=0 (the initial condition): 


u(x, y, 2, 0) =ọẸ(x, y, 2) (9) 


In addition to that we must know the temperature at any point M 
of the surface o of the body at any time ¢ (the boundary condi- 
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tion): 
u (M, t)=(M, t) (10) 


(Other boundary conditions are possible teo.) 

If the desired function u(x, y, z, t) is independent of z, which 
corresponds to the temperature being independent of z, we obtain 
the equation 


ð ð? ð? 
gee (4%) an 


which is the equation of heat transfer in a plane. 

If we consider heat transfer in a flat domain D with boundary C, 
then the boundary-value conditions, like (9) and (10), are formu- 
lated as follows: 


u (x, Y, 0)=ọ (x, y) 
u(M, t)=(M, t) 


where ọ and p are specified functions and M is a point on the 
boundary C. 
But if the function u does not depend either on z or on y, then 
we get the equation 
Ou _ ga Ou 
ðt Ox 


which is the equation of heat transfer in a rod. 


6.6 SOLUTION OF THE FIRST BOUNDAR Y-VALUE 
PROBLEM FOR THE HEAT-CONDUCTION EQUATION 
BY THE METHOD OF FINITE DIFFERENCES 


As in the case of ordinary differential equations, when we solve 
partial differential equations by the method of finite differences, 
the derivatives are replaced by appropriate differences (see Fig. 143). 


Ou (x, t) es u(x+h, t)—u (x, t) (1) 
Ox h 
Gu (x, t) 1 k (x+h, t)—u (x, t)__u (x, th—u(x—h, 2] 
ox Th h h 
or 
ð?u (x, t) u (x+h, t)—2u (x, t)4-u (x—h, t) (2) 
on™ h? 
similarly, 
ðu (x, t u (x, t+l)—u (x, t 
x PS } (x, t) (3) 


The first boundary-value problem for the heat-conduction equation 
is stated (see Sec. 6.4) as follows. It is required to find the solution 


25 * 
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of the equation 


Oo oe (4) 
that satisfies the boundary-value conditions 
u(x, 0)= 9 (x), O<x<L (5) 
u (0, t)=y, (t) O<t<T (6) 
u (l, =p, (f), O<t<T (7) 


that is, we have to find the solution u (x, £) in a rectangle bound- 
ed by the straight lines f=0, x=0, x=L, t=T, if the values 
of the desired function are giv- 
en on three of its sides: ¢=0 


t 
(Zt+l) 


(x-h,t) (Zt) (zth;t) 


Fig. 143 Fig. 144 


x=0,x=L (Fig. 144). We cover our region with a grid formed by the 
straight lines 

x= th, Cs De ees 

t=Al, k=1, 2,... 


and approximate the values at the lattice points of the grid, that 
is, at the points of intersection of these lines. Introducing the no- 
tation u (ih, kl) = u;, x, we write [in place of equation (4)] a cor- 
responding difference equation for the point (ih, kl). In accord 
with (3) and (2), we get 


Ui k+i— Mik _ gUi+i,k— 2U, k+ Uii, k (8) 

— = R? maa 
l hè 

We determine w;, p+: 


2a?l l 
Ui, kt = (1—75) Uj, r HO Fe (Wiss, et Uima, a) (9) 


From (9) it follows that if we know three values in the kth row: 
Uik Uite Ui- gs We can determine the value u;,,, in the 
(k+ 1)th row. We know all the values on the straight line t=0 
[see formula (5)]. By formula (9) determine the values at all the 
interior points of the segment ¢=/. We know the values at the 
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end points of this segment by virtue of (6) and (7). In this way, 
row by row, we determine the values of the desired solution at all 
lattice points of the grid. 

It may be proved that from formula (9) we can obtain an ap- 
proximate value of the solution not for an arbitrary relationship 


between the steps h and l, but only for/< ak Formula (9) is 


greatly simplified if the step length / along the ¢-axis is chosen so 


that we 
ae 


or ‘a 
l= gE 
In this case, (9) takes the form 


I 
Ui, r41 = p isi, e+ Uii, k) (10) 


This formula is particularly convenient for computations (Fig. 145). 


This method gives the solution at the lattice 

points of the grid. Solutions between these a ae 
points may be obtained, for example, by ext: isa 
rapolation, by drawing a plane through every a 
three points in the space (x, ¢, u). Let us de- | - 
note by u, (x,t) asolution obtained by formula ®©% (hk) 
(10) and this extrapolation. It can be proved that Fig. 145 


lim u, (x, t)=u (x, t) 
h>0 


where u(x, t) is the solution of our problem. It can also be proved* 
that 
Ju, (x, t)—u (x, t)| < Mh? 


where M is a constant independent. of h. 


6.7 HEAT TRANSFER IN AN UNBOUNDED ROD 


Let the temperature be given at various sections of an unbound- 
ed rod at an initial instant of time. It is required to determine 
the temperature distribution in the rod at subsequent instants cf 
time. (Physical problems reduce to that of heat transfer in an un- 
bounded rod when the rod is so long that the temperature in the 


* This question is dealt with in more detail in D. Yu. Panov’s Handbook 
of Numerical Solulions of Partial Differential Equations, Gostekhizdat, 1951; 
Lothar Collatz, Numerische Behandlung von Differentialgluchungen, 2nd edi- 
tion, Springer, 1955. 
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interior points of the rod at the instants of time under considera- 
tion is but slightly dependent on the conditions at the ends 
of the rod.) 

If the rod coincides with the x-axis, the problem is stated ma- 
thematically as follows. Find the solution to the equation 


0 0? 
ne at (1) 
in the region —oo<x< oo, 0<?, which satisfies the initial 
condition 
u(x, 0)=9 (x) (2) 


To find the solution, we apply the method of separation of 
variables (see Sec. 6.3); that is, we shall seek a particular solution 
of equation (1) in the form of a product of two functions: 


u(x, t)=X (x) T (t) (3) 

Putting this into equation (1) we have X (x) T’ (t) =a?X" (x) T (t) 
or 

Pi KE ys (4) 

Neither of these relations can be dependent either on x or on t; 


therefore, we equate them to a constant,*—A?. From (4) we get 
two equations: 


T’+a°VT =0 (5) 
X"+X =0 (6) 
Solving them we find 
T =Ce-o™Mt 


X = Acos àx + B sin àx 
Substituting into (3), we obtain 
u, (x, t) = e7% [ A (À) cos àx + B (A) sin àx] (7) 


[the constant C is included in A(A) and in B(A)]. 

For each value of 4 we obtain a solution of the form (7). For 
each value of A the arbitrary constants A and B have definite 
values. We can therefore consider A and B functions of 4. The sum 
of the solutions of form (7) is likewise a solution [since equation (1) 
is linear]: 

Z e-on" [A (A) cos hx +- B (A) sin Ax] 


* Since from the meaning of the problem T (t) must be bounded for any t 


if @ (x) is bounded, it follows that T must be negative. And so we write —A?, 
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Integrating expression (7) with respect to the parameter à between 0 
and oo, we also get a solution 


o 


u(x, t) = È e=0™ [A (A) cos Ax-+ B (à) sin Ax] dì (8) 
0 


if A(\) and B (À) are such that this integral, its derivative with 
respect to ¢ and the second derivative with respect to x exist and 
are obtained by differentiation of the integral with respect to ¢ 
and x. We choose A (à) and B (à) such that the solution u(x, t) 
satisfies the condition (2). Putting ¢=0 in (8), we get [on the 
basis of condition (2)]: 


u(x, 0)=@ (x) = f [A (A) cos àx + B (À) sin Ax] dà (9) 
0 


Suppose that the function ọ (x) is such that it may be represented 
by the Fourier integral (see Sec. 5.13): 


P (=> \( f @ (a) cos À (a — x) da ) dn 


0 
o=a/{( f P (2) cosha da ) cos 
0 


œ 


+(f (2) sina da) sinh |an (10) 


-0 


Comparing the right sides of (9) and (10), we get 


AM =+ f @ (a2) cos àa da 


à (11) 
B(A) = f @ (a) sin Ao da 


Putting the expressions thus found of A (A) and B (à) into (8), we 
obtain 


u (x, dag lem(( f P (2) cosha da.) cose 
0 -o 
+o 


+ ( f @ (a) sin àa dn) sin g da 


-0 
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2 @ 
= + ena*att | f @ (a) (cos àa cos Ax + sin àa sin Ax) aa | dà 
0 


sai ge { Q (a) cos À (a — x) da) dn 
ale 


or, interchanging the order of integration, we finally get 


© 


[ore ( feet cosh ta— ayan) |an (12) 


0 


u (x, fal ( 


n 
This is the solution of the problem. 


Let us transform formula (12). Compute the integral in the 
parentheses: 


S RET ERE E asa 
J: aM cos À (a —x) dà vil? 2" cos Bz dz (13) 
The integral ís transformed by substitution: 
pay a—x 
ahVii=2z, a= (14) 
We denote 
K (B) = § e77" cos Bz dz (15) 
0 


Differentiating,* we get 


K’ (6) =— f e*" z sin Bzdz 
0 
Integrating by parts, we find 


K’ (B) =+ [e-2" sin peje —8 f e-*" cos Bz dz 


K' (B= ÊK) 


Integrating this diferential equation, we obtain 


B 
K(p)=Ce * . (16) 


* Differentiation here is easily justified. 
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Determine the constant C. From (15) it follows that 


K (=| es*de— 
0 
(see Sec. 2.5). Hence, in (16) we must have 


And so 
= -8 
K (6) = ne (17) 


Put the value (17) of the integral (15) into (13): 


ao 


; Ge abe 
Jere oie posits, 4 
0 


aVi 2 


In place of B we substitute its expression (14) and finally get the 
value of the integral (13): 


° (a-x)* 


[ e-em cosà (a—2) d=} V te er (18) 
0 


Putting this expression of the integral into the solution (12), we 
finally get 


(a — x)? 


u(t N= f (aje T da (19) 


This formula, called the Poisson integral, is the solution to the 
problem of heat transfer in an unbounded rod. 

Note. It may be proved that the function u(x, t), defined by 
integral (19), is a solution of equation (1) and satisfies condition 
(2) if the function @(x) is bounded on an infinite interval (—oo, oo). 

Let us establish the physical meaning of formula (19). We con- 
sider the function 


0 for —w<x<x, 

g(x) ={ P(x) for x, << x<x,+ Ax (20) 
0 for x,+Ax<x< œ 

Then the function 


œ 
—x)® a 
1 (a—- x) 


ur(x, t)= uya f g'(aje At da (21) 


-0 
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is the solution to equation (1), which solution takes on the value 
#* (x) when ¢=0. Taking (20) into consideration, we can write 


Xo tAx 


_(a-x)* 
bd gol aat 
u* (x, t) Va J (aje da 
Applying the mean-value theorem to the latter integral, we get 
_ (=x)? 
u*(x, t)= tome ae x < E< HA (22) 


Formula (22) gives the value of temperature at a point in the rod 
at any time if for ¢=0 the temperature in the rod is everywhere 
u*= 0, with the exception of the interval [x,, Xo + Ax] where it is 
@ (x). The sum of temperatures of form (22) is what yields the 
solution of (19). It will be noted that if p is the linear density 
of the rod, c the heat capacity of the material, then the quantity 
of heat in the element [x,, x, + Ax] for ¢=0 will be 


AQ + p ($) Ax pc (23) 
Let us now consider the function 


—e «ar (24) 


Comparing it with the right side of (22) and taking into account 
(23), we may say that it yields the temperature at any point of 
the rod at any instant of time ¢ if for ¢=0 there was an instan- 
taneous heat source with amount of heat Q = cp in the cross section & 
(the limiting case as Ax — 0). 


6.8 PROBLEMS THAT REDUCE TO INVESTIGATING 
SOLUTIONS OF THE LAPLACE EQUATION. 
STATING BOUNDARY-VALUE PROBLEMS 


In this section we shall consider certain problems that reduce to 
the solution of the Laplace equation: 


ð? 02 
Sets +55 =0 (1) 


As already pointed out, the left side of equation (1) is symbolized by 
Ou ðu 


get ot oe 02? = Au 


where A is called the Laplacian operator. The functions u which 
satisfy the Laplace equation are called harmonic functions. 
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I. A stationary (steady-state) distribution of temperature in a 
homogeneous body. Let there be a homogeneous body Q bounded 
by a surface o. In Sec. 6.5 it was shown that the temperature at 
various points of the body satisfies the equation 


ðu _ a/u , Ou , Ou 
a7’ (Sr + ar x) 


If the process is steady-state, that is, if the temperature is not 
dependent on the time, but only on the coordinates of the 


points of the body, then o and, consequently, the tempera- 


ture satisfies the Laplace equation 
Ou , Mu , du 


oat + aye + Gee =O 1 


To determine the temperature in the body uniquely from this equa- 
tion, one has to know the temperature on the surface o. Thus, for 
equation (1), the boundary-value problem is formulated as follows. 

Find the function u(x, y, z) that satisfies equation (1) inside 
the volume Q and that takes on specified values at each point M 


of the surface o: 
u |o = p (M) (2) 


This problem is called the Dirichlet problem or the first boundary- 
value problem of equation (1). 

If the temperature on the surface of the body is not known, but 
the heat flux at every point of the surface is, which is proportional 


to se (see Sec. 6.5), then in place of the boundary-value condi- 
tion (2) on the surface o we will have the condition 


se] =4* (M) (3) 


The problem of finding the solution to (1) that satisfies the boun- 
dary-value condition (3) is called the Neumann problem or the se- 
cond boundary-value problem. l 

If we consider the temperature distribution in a two-dimensional 
domain D bounded by a contour C, then the function u will de- 
pend on two variables x and y and will satisfy the equation 


0? ð? 
or + at =0 (4) 


which is called the Laplace equation in a plane. The boundary- 
value conditions (2) and (3) must be fulfilled on the contour C. 

II. The potential flow of a fluid. Equation of continuity. Let there 
be a flow of liquid inside a volume Q bounded by a surface o 
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(in a particular case, may also be unbounded). Let p be the 
density of the liquid. We denote the velocity of the liquid by 


v=v,i+0,J+0,k (5) 
where v,, v,, Vz are the projections of the vector v on the coordi- 
nate axes. In the body Q pick out a small volume w, bounded 


by the surface S. The following quantity of liquid will pass through 
each element As of the surface S in a time At: 


AQ =p on As At 


where ø is the unit vector directed along the outer normal to the 
surface S. The total amount of liquid Q entering the volume œ 
(or flowing out of the volume w) is expressed by the integral 


Q = At i) pon ds (6) 
(see Secs. 3.5 and 3.6). The amount of liquid in the volume œ 


at time ¢ was 
fff pdo 
(0) 


During time Af the amount of liquid will change (due to changes 
in density) by the amount 


Q= SSS o dm æ at SSN Sdo (7) 


Assuming that there are no sources in the volume œ, we con- 
clude that this change is brought about by an influx of liquid to 
an amount that is determined by equation (6). Equating the right 
sides of (6) and (7) and cancelling out At, we get 


iN) ponds= + SVS ar ® de (8) 


We transform the iterated integral on the left by Ostrogradsky’s 
formula (Sec. 3.8). Then (8) will assume the form 


i) div (o0) do = S\N F ® do 
SS (ar — aiv 9) ) do =0 


Since the volume œ is arbitrary and the integrand is continuous, 
we obtain 


or 


— div (px) =0 (9) 
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or 


FS (po) — 3 (00) — z: 2 (pu,) =0 (9°) 


This is the equation of continuity of a coinntessible liquid. 

Note. In certain problems, for instance when considering the 
movement of oil or gas in a subterranean porous medium to a well, 
it may be taken that 


o=—~ grad p 


where p is the pressure and & is the coefficient of permeability and 


OP y 2p 
a hor 


à= const. Substituting into the equation of continuity (9), we get 


a ÊP 4 div (k grad p)=0 


or 
op _ ô Op ð Op ð Op 
Bena Bae) tay (ha tata) 0) 
If kisa constant, then this equation takes on the form 
0 ð? ð? 
Tecra ta Ta) (11) 


and we arrive at the heat-conduction equation. 
Let us return to equation (9). If the liquid is incompressible, 


then p= const, 0, and (9) becomes 
divo=0 (12) 
If the motion is potential, that is, if the vector v is the gradient 
of some function gq: 
v=gradq 
then equation (12) takes the form 
div (grad p) =0 
or 
So 4 S84 =0 (13) 


that is, the potential function of the velocity @ must satisfy the 
Laplace equation. 
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In many problems, as, for example, those dealing with filtration, 
we can put 
v= — k, grad p 


where p is the pressure and k, is a constant; we then get the Lap- 
lace equation for determining the pressure: 


Bp , ap , ð ; 
He 5 oe 4 HP _o (13°) 


The boundary-value conditions for equation (13) or (13’) may 
be the following: 

1. On the surface ø are specified the values of the desired 
function p, pressure [condition (2)]. This is the Dirichlet problem. 

2. On the surface o are specified the values of the normal de- 


rivative oe ; the flow through the surface is specified [condition (3)]. 


This is the Neumann problem. 
3. On parts of the surface o are specified the values of the 
desired function p, pressure, and on parts of the surface are spe- 


cified the values of the normal derivative oe. the flux through the 


surface. This is the Dirichlet-Neumann problem. 

If the motion is two-dimensional-parallel—that is, the function 
(or p) does not depend on z—then we get the Laplace equation 
in a two-dimensional domain D with boundary C: 


se tao (14) 


Boundary-value conditions of type (2), the Dirichlet problem, or 
of type (3), the Neumann problem, are specified on the contour C. 

III. The potential of a steady-state electric current. Let a ho- 
mogeneous medium fill some volume V, and let an electric current 
pass through it whose density at each point is given by the vector 
J(x, y, 2)=J,i+J,J+J,k. Suppose that the current density is 
independent of the time ¢. Further assume that there are no cur- 
rent sources in the volume under consideration. Thus, the flux of 
the vector J through any closed surface S lying inside the volume 
V will be equal to zero: 


\\ Jnds=0 
S 


where # is a unit vector directed along the outer normal to the 
surface. From Ostrogradsky’s formula we conclude that 
divJ=0 (15) 


The electric force E in the conducting medium at hand is, on the 


6.9 The Laplace Equation in Cylindrical Coordinates 399 
basis of Ohm’s generalized law, 


J 
E=> (16) 


or 
J=iVE 


where À is the conductivity of the medium, which we shall con- 
sider constant. 

From the general electromagnetic-field equations it follows that 
if the process is stationary, then the vector field E is irrotational, 
that is, rot E=0. Then, like the case we had when considering 
the velocity field of aliquid, the vector field is potential (see Sec. 3.9). 
There is a function @ such that 


E-=grad¢ (17) 
From (16) we get 
J=Agrad@ (18) 


From (15) and (18) we have 


A div (grad p) =0 
or l 
ar or or 
$24 08458 —0 (19) 
We thus have the Laplace equation. 
Solving this equation for appropriate boundary-value conditions, 
we find the function ọ, and from formulas (18) and (17) we find 
the current J and the electric force E. 


6.9 THE LAPLACE EQUATION IN CYLINDRICAL 
COORDINATES. SOLUTION OF THE DIRICHLET PROBLEM 
FOR AN ANNULUS WITH CONSTANT VALUES 
OF THE DESIRED FUNCTION ON THE INNER 
AND OUTER CIRCUMFERENCES 


Let u(x, y, z) be a harmonic function of three variables. Then 


Ou Ou Ou 


a ty oa? (1) 
We introduce the cylindrical coordinates (r, p, 2): 


x=rcosg, x=rsing, z=z 
whence 


r=V xX FP, p=arctan~, z=z (2) 
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Replacing the independent variables x, y, and z by r, 9, and z, 
we arrive at the function u*: 
u(x, y, z)=uU*(r, p, 2) 
Let us find the equation that will be satisfied by u*(r, p, z) asa 
function of the arguments r, g, arid z; we have 
u _ðu*ðr , ðu* Op 


Ox Or ox | Op Ox 


Otu Gu /Ar\* | du* Or , g uk Or dp , Gut (dp \? Bu? OD 
Sat = oF (3) +o at + 2 Sr aq a 3e + Sar (oe) +a oat (3) 
similarly, 
au _ aut (ar)? Out dtr | g Oue r ap | ue (Ay)? ut (4) 
ay? Dr \ dy Or dy? | “drag dy oy ' op \ dy Op oy? 
besides, 
ðu d2u* 
oe ae (5) 


We find the expressions for 
Or Or Or Or dp dap Ap Ap 
ox’ oy’ Ox?’ Oy?’ “ox? Oy’ Ix? ’ oy? 
from equations (2). Adding the right sides of (3), (4) and (5), and 
equating the sum to zero [since the sum of the left-hand sides of 
these equations is zero by virtue of (1)], we get 
@?u* 1 ðu* 1 @?u* — g?u* 
aa a tr gt + oe =O (6) 


This is the Laplace equation in cylindrical coordinates. 

If the function u is independent of z and is dependent on x and 
y, then the function u*, dependent only on r and ọ, satisfies the 
equation 

@?u* 1 ðu* 1 O%u* 
aetra a y =O (7) 
where r and @ are polar coordinates in a plane. 

Now let us find the solution to Laplace’s equation in tne domain D 
(annulus) bounded by the circles C,, x? + y? = R?, and C,, x? + y? = R?, 
with the following boundary values imposed: 


ulc, Su, (8) 
ulc, = u, (9) 
where u, and u, are constants. 


We will solve the problem in polar coordinates. Obviously, it 
is desirable to seek a solution that is independent of pọ. Equation 
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(7) in this case takes the form 


Integrating this equation we find 
u=Alnr+B (10) 
We determine A and B from conditions (8) and (9): 
u,=AlnR,+B 
u,=AlnR,+B 
Whence we find 
B=u,—(u,—u,) In Ri __ 4 In Re—ue In Ry 


at Re 
In R, In R, R, 


Substituting the values of A and B thus found into (10), we 
finally get 


In% ua In —u, In < 
T alt tle 
u =u, + R, (u, — u) = R, ž (11) 
Ri aR, 


Note. We have actually solved the following problem. Find the 
function u that satisfies the Laplace equation in a region bounded 
by the surfaces (in cylindrical coordinates) 


r=R, r=R, z=0, z=H 
and that satisfies the following boundary conditions: 
ulr=R, =U, U|r=R, = Uy 
ah. Al 286 


z=0 


(the Dirichlet-Neumann problem). It is obvious that the desired 
solution does not depend either on z or on ọ and is given by for- 
mula (11). 


6.10 THE SOLUTION OF DIRICHLET’S PROBLEM 
FOR A CIRCLE 


In an xy-plane, let there be a circle of radius R with centre at 
the origin and let a certain function f(p), where g is the 
polar angle, be given on its circumference. It is required to 
find the function u(r, ọ) continuous in the circle (including 
the boundary) and satisfying (inside the circle) the Laplace equa- 
tion 

u , u 
26 —2082 
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and, on the circumference, assuming the specified values 
u|--R=f (9) (2) 
We shall soive the problem in polar coordinates. Rewrite equation 
(1) in these coordinates: 
Ou , 1 ðu 1 ðu 


ait Far t 78 agi 9 
or 
roa tret+ FH 0 (1’) 
We shall seek the solution by the method of separation of variables, 
placing 
u= (9) R (r) (3) 


Substituting into equation (1’), we get 


PD (P) R"(r) + r® (p) R’ (r) +O" (9) R (7) =0 
or 
D” (p) PART (r) +rR' (r) pe (4) 


DA RW) 
Since the left side of this equation is independent of r and the 
right is independent of ọ, it follows that they are equal to a 
constant which we denote by —k?. Thus, equation (4) yields two 
equations: 


D” (p) +k’ (p) =0 (5) 
rR” (r)+rR' (r)—kR(r)=0 (5°) 

The general solution of (5) will be 
® = A cos kọ + B sin kọ (6) 


We seek the solution of (5’) in the form R (r) =r”. Substituting 
R(r)=r™ into (5’), we get 
rm (m— 1)r7-? + rmr™-1— R?r® =0 
or 
m—k?=0 
Thus, there are two particular linearly independent solutions r* and 
r-t. The general solution of equation (5’) is : 


R =Cr* + Dr-* (7) 
We substitute expressions (6) and (7) into (3): 
u, = (A, cos ko + B, sin kp) (Cpr? + D,r-*) (8) 


Function (8) will be the solution of (1’) for any value of k different 
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from zero. If k=0, then equations (5) and (5’) take the form 
©” =0, rR” (r) + R’ (rn) =0 
and, consequently, i 
Uy = (A, + Bog) (Ca + Do Inr) (8) 


The solution must be a periodic function of g, since for one and 
the same value of r for ọ and »+2n we must have the same so- 
lution, because one and the same point of the circle is considered. 
It is therefore obvious that in formula (8’) we must have B,=0. 
To continue, we seek a solution that is continuous and finite in 
the circle. Hence, in the centre of the circle the solution must be 
finite for r=0, and for that reason we must have D,=0 in (8’) 
and D,=0 in (8). 

Thus, the right side of (8’) becomes the product A,C,, which 
we denote by A,/2. Thus, 


A ” 
u=> (8”) 


We shall form the solution to our problem as a sum of solutions 
of the form (8), since a sum of solutions is a solution. The sum 
must be a periodic function of ọ. This will be the case if each 
term is a periodic function of ọ. For this, k must take on integral 
values. [We note that if we equated the sides of (4) to the number 
+k’, we would not obtain a periodic solution.] We shall confine 
ourselves only to positive values: 


k= h | eee 
because the constants A, B, C, D are arbitrary and therefore the 


negative values of k do not yield new particular solutions. 
Thus, 


u(r, = 24S (A, cos np + B, sin ng) r” (9) 


n=l 


(the constant C, is included in A, and B,). Let us now choose 
arbitrary constants A, and B, so as to satisfy the boundary-value 
condition (2). Putting into (9) r=R, we get, from condition (2), 


F= D(A, cos ap +B, sinng) R” (10) 
n=1 
For (10) to be valid, it is necessary that the function f(ọ) be 


expandable in a Fourier series in the interval (—mx, x) and that 
A,R" and B,R" be its Fourier coefficients. Hence, A, and B, must 
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be defined by the formulas 


A, =e J FUE) cos nt dt 
Bs (11) 


n 
1 ; 
Ba= apr T Ostania 


Thus, the series (9) with iie defined by formulas (11) will 
be a solution of our problem if it admits termwise itèrated diffe- 
rentiation with respect to r and @ (but we have not proved this). 
Let us transform formula (9). Putting, in place of A, and B,, 
their expressions (11) and performing the trigonometric transfor- 
mations, we get 


utr, Daa Odi >> Jr eosae—oyat( 


T 
1 n 
= xf 10[1428,(%) cosn(t—) |a (12) 
in n=l 
Let us transform the expression in the square brackets: * 


1425 (4 i coon =1 +E ( y [ein (t-9) 4. e-intt-o)] 


-1+È (p v)" +(e] 
of (t-9) pao 


=14 


l e A Ie tw) 
r 2 
Ce) pores) 
1-25 cost +( 4) R*— 2Rr cos (¢—) +r 


Replacing the expression in square brackets in (12) by expres- 
sion (13), we get 


m 
1 R3—r? 
u(r, D= a NO aea TA (14) 
-n 


* In the derivation we determine the sum of an infinite geometric prog- 
ression whose ratio is a complex number, the modulus of which is less than 
unity. This formula of the sum of a geometric progression is derived in the 
same way as in the ease of real numbers. It is also necessary to take into 
account the definition of the limit of a complex function of a real argument. 
Here, the argument is n (see Sec. 7.4, Vol. I). 
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Formula (14) is called Poisson’s integral. By an analysis of this 
formula it is possible to prove that if the function f (@) is con- 
tinuous, then the function u(r, ọ) defined by the integral (14) 
also satisfies equation (1’) and u(r, p)-—*f (pọ) as r— R. That is, 
it is a solution of the Dirichlet problem for a circle. 


6.11 SOLUTION OF THE DIRICHLET PROBLEM 
BY THE METHOD OF FINITE DIFFERENCES 


In an xy-plane, let there be given a domain D bounded by 
a contour C. Let there be given a continuous function f on the 
contour C. It is required to find an approximate solution to the 
Laplace equation 

Ou 


of 
ei + a8 =O (1) 


that satisfies the boundary condition 


ulo=f (2) 
We draw two families of straight lines: 
x=ih and y=kh (3) 


where h is the given number, and i and k assume successive integral 
values. We shall say that D is covered with a grid. We call the 
points of intersection of the straight $ 
lines lattice points of the grid. y c 
We denote by u; , the approxi- 
mate value of the desired function 
at the point x= ih, y= kh; that is, 
u (ih, kh)=u;,,. We approximate 
D by the grid domain D*, which 
consists of all the squares that lie 
completely in D and of some that 
are crossed by the boundary C 
(these may be disregarded). Here, 
the contour C is approximated by 
the contour C*, which consists of 
segments of straight lines of type Fig. 146 
(3). In each lattice point lying on 
the contour C* we specify a value f*, which is equal to the va- 
lue of the function f at the closest point of the contour C (Fig. 146). 
The values of the desired function will be considered only at 
the lattice points of the grid. As has already been pointed out 
in Sec. 6.6 the derivatives in this approximate method are replaced 
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by finite differences: 


Ou Uti, k — Ui, k+ Ui-1, k 
DXZ |xxth, y=kh k ` 

Ou Mit Ui, k HU, ad 
Oy? x=ih, y=kh h? 


The differential equation (1) is replaced by a difference equation 
(after cancelling out h?): 


Uiti, k 2Uj;, p+ Uma, k H Ui, kti 2U, p+ Ui, p-1 =9 
or (Fig. 147) 
Ui, p= 7 (Wiss, e+ Ui, pert Ui- e+ Ui, k1) (4) 
For each lattice point of the grid lying inside D* (and not lying 


on the boundary C*), we form an equation (4). If the point (x = ih, 
y -= kh) is adjacent to the point of the contour C*, then the right 


side of (4) will contain known values of f*. Thus, we obtain a 

y ae nonhomogeneous system of N equations 

Erena in N unknowns, where N is the number 

EAA e We shall prove that the system (4) 

has one, and only one, solution. This 

is a system of N linear equations in N 

zero. The determinant of the system is 

nonzero if the homogeneous system has only a trivial solution. The 

system will be homogeneous if f*=0 at the lattice points on the 

to zero. Inside the domain, let .u;, „ be different from zero. For the 

sake of .definiteness, we assume that the greatest of them is posi- 
tive. Let us designate it by u;,,>0. 


of lattice points of the grid lying in- 

BURSE unknowns. It has a unique solution if 

boundary of the contour C*. We shall prove that in this case all 
By (4) we write 


side D*. 
Fig. 147 the. determinant of the system is not 
the values u;,ą at all interior lattice points of the grid are equal 
1 , 
Ui, p= g (Lirie t Uir tUi- t 4, k-1) (4’) 


This equation is possible only if all the values of .u on the 
right are equal to the greatest u;,,. We now have five points at 
which the values of the desired function are u;,,. If none of these 
points is a boundary point, then, taking one of them and writing 
for it the equation (4), we will prove that at certain other points 
the value of the desired function will be equal to u;,,. Continuing 
in this fashion, we will reach the boundary and will prove that 
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at the boundary point the value of the function will be equal to 


u;i, k» Which is contrary to the fact that f*=0 at boundary points. 

Assuming that inside the domain there is the least negative 
value, we will prove that on the boundary the value of the function 
is negative, which contradicts the hypothesis. 

And so system (4) has a solution and it is a unique solution. 

The values u;,, defined from the system (4) are approximate 
values of the solution of the Dirichlet problem formulated above. 
It was proved that if the solution of the Dirichlet problem for 
a given domain D and a given function f exists [we denote it by 
u(x, y)) and if u;,, is a solution of (4), then we have the relation 

|u (x, y)— ti, g| < Ah? (5) 
where A is a constant independent of h. 

Note. It is sometimes justifiable (though this has not been rigo- 
rously proved) to use the following procedure for estimating the 
error of the approximate solution. Let ut% be an approximate so- 
lution for a step 2h, ui, an approximate solution for a step h, 
and let E, (x, y) be the error of the solution u‘”,. Then we have 
the approximate equation 


1 
Ey (x, y) = 5 (up — u) 


at the common lattice points of the grids. Thus, in order to deter- 
mine the error of the approximate solution for a step h, it is 
necessary to find the solution for a step 2h. One third of the diffe- 
rence of these approximate solutions is the error estimate of 
the solution for a step (mesh-length) of h. This remark also refers 
to the solution of the heat-conduction equation by the finite-diffe- 
rence method. 
Exercises on Chapter 6 


1. Derive an equation of torsional vibrations of a homogeneous cylindrical rod. 
Hint. The torque in a cross section of the rod with abscissa x is determined 


by the formula m=61®, where 0 (x, ¢) is the angle of torque of a cross 


section with abscissa x at time ¢, G is the shear modulus, and / is the polar 
moment of inertia of a cross section of the rod. 
. 2 GI 
ees pA 2 SE : ST ‘ 

Ans. TD =a Ont? where a k’ and k is the moment of inertia of unit 

length of the rod. 
; : . 026 ord , bn 

2. Find a solution of the equation aR” Ja that satisfies the conditions 

0 (0, 4)=0, O (L, #)=0, O(x, 0) = (x), 2go 


(x)= L for 0 <x<t 


p= et +285 for EET 


=0, where 
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Give a mechanical interpts tation of the problem. 


80, (—1)* (2e+1)nx (2k +1) nat 
Ans. 0 (x, ont Dor sin =r oos 7 j 
re Derive an equation of longitudinal vibrations of a homogeneous cylindrical 
rod. 
Hint. If u(x, t) is the translation of a cross section of the rod with abs- 
cissa x at time ?, Er the tensile stress T in a cross section x is defined by 


the formula T = ES% where E is the elasticity modulus of the material and S 
is the cross-sectional area of the rod. 
Ou _ ,0?u 3E ; : 
Ans. oe =O aya where a =r and p is the density of the rod ma- 
terial. 


4. A homogeneous rod of length 2L was shortened by 2A under the action of 
forces applied to its ends. At £=0 it is free of forces acting externally. Deter- 
mine the displacement u(x, ¢) of a cross section of the rod with abscissa x at 
time ¢ (the mid- P or the axis of the rod has abscissa x= 0). 


(SAE jn CAE DAE os CEED nat 
Ler (2k FI 2 21 

5. One end of a tod “af length / is fixed, the other end is acted upon by a 
tensile force P. Find the longitudinal vibrations of the rod if the force P does 


8Pl 3 (—1)" (2n-+1) nx os (2n+ 1) nat 


sin 


Ans. u(x, n=% 


not operate when ¢=0. Ans. 


ESn? (2n +1)? 2l 21 
(E and S as in Problem 3). a 
6. Find a solution to the equation Tin ar that satisfies the conditions 
u (0, t)=0, u (l, t)= A sin œt 
Bap ðu (x, 0) __ 
u (x, 0)=0, Ot =0 


Give a mechanical interpretation of the problem. 
Asin x sinwt 


ao 
2Awa YN (—1)#-1 . nat . nnx 
Ans. u (x, fe ee ————;,; sin —— sin —. 
sin 1 l Zo (E l f 


Hint. Seek the solution in the form of a sum of two solutions: 


PEE ee 
A sin — xsin œt 
u=v+w, where w= = 
. 0 
sin — l 
a 
is the solution that satisfies the conditions 
o (0, t)=0, v(l, t)=0 


vu (x, 0) = —-w (x, 0), % 2g n_h, 0) 


(1 is assumed that sin Sf # 0.) 
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7. Find a solution to the equation ot aa? a that satisfies the conditions 


u(0, t)=0, u(l. t)=0,, t>0 


x when oxra} 


u (x, 0)= 1 2 
l—x when y <x <1 
o _(2n+1)? n?a?t 
(—1)" 12 . (2n+ 1) nyx 
Ans. u(x, n=4 r Dearie sin A. 


Hint. Solve the en by the method of separation of variables. 
8. Find a solution to the equation Di es a= that satisfies the conditions 


ot Ox? 
u(0, t)=u (l, t)=0, u(x, = =a) 
8 E 1 (241)? watt (2n-+ 1) nx 
Zs E a ine 
Ans. u (x, N= h Oi’ sin i á 
n=0 
: R . Ou a? u 
9. Find a solution to the equation a a =; that satisfies the conditions 


Ou 
Ox |x 
Point out the physical meaning of the problem. 


an u (l, t)= lo, u (x, 0)=ọ (x) 


eo 
Ans. u(x, t)=ug+ FAren t cos Cons x, where 


n=0 


An=7 |P 0) cos x CAT DTE gp Dru 
0 


al (2a 1)° 
Hint. Seek the solution in the form u=uy+0 (x, t). 
10. Find a solution to the equation wag De that satisfies the conditions 
u0, y=0, 28 — Hu u (x, 0) = (x) 
, , Ox apo x=b , 
Point out the physical ae of the problem. 
A užari’ 
Ans. u(x, t)= An p? Phi ze BP sin tž, where 
Be ” p(p+1)+bn l 
l 
=z | Bet Has «++, Py are positive roots of the 
equation tan pat. 


Hint. At the ead. of the rod (when x=1) a heat exchange occurs with the 
environment, which has a temperature of zero. 
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11. Find [by formula (10), Sec. 6.6, putting 4=0.2] an approximate solution 


‘ u u ; me 
to the equation a7? a that satisfies the conditions 


u(x, 0) =x ($-*) , u(0, 1)=0, u(l, N=>, OsicAl 


Ou 


ae" in a strip 


3 
12. Find a solution to the Laplace equation a + 
d<x<a, 0<y < @ that satisfies the conditions 


u(0, y)=0, u(a, y)=0, u(x, 0)=A (1-4), u(x, 0) =0 


2A% l -Ey _ nns 
Ans. u (x, n= F ae sin —. 
n=1 
Hint. Use the method of the separation of variables. 
13. Find a solution to the Laplace equation Set Se=0 in the rectangle 
O<x<a, O<y<b that satisfies the conditions 


u(x, 0)=0, u(x, b)=0, u(0, yy=Ay(b—y), u(a, y)=0. 


E sinh C24 I Ae) sin CDY 
Ans. u(x, t)= b Doman 275 | aa SeeD 
s ns (2n + 1)8 ._, (2n+1) na 
n=O sinh-——-— 
; À . Ou , Ou tte 
14. Find a solution to the equation On toe inside an annulus boun- 
ded by the circles x?-+ y2= R?, x®+ y? = R? that satisfies the conditions 
Ou 


Or or, T honk, |r Ra M8 
Give a hydrodynamic interpretation of the problem. 
Hint. Solve the problem in polar coordinates. 


Ans. u =u, —5— In—. 


15. Prove that the function u(x, y)=e-¥ sin x is a solution of the equation 
2 2 
Tepi in the square O< x< 1, OS y <<! that satisfies the conditions 
u(0, y)=0, u(l, y)=e-¥ sin 1, u(x, 0)=sinx, u(x, 1)=e7! sin x. 
16. In Problems 12-15 solve the Laplace equations for given boundary con- 
ditions by the finite-difference method for h=0.25. Compare the approximate 
solution with the exact solution. 


CHAPTER 7 


OPERATIONAL CALCULUS AND 
CERTAIN OF ITS APPLICATIONS 


Operational calculus is an important branch of mathematical 
analysis. The methods of operational calculus are used in physics, 
mechanics, electrical engineering and elsewhere. Operational calcu- 
lus finds especially broad applications in automation and . teleme- 
chanics. In this chapter we give (on the basis of the foregoing 
material of this text) the fundamental concepts of operational cal- 
culus and operational methods of solving ordinary differential 
equations. * 


7.1 THE ORIGINAL FUNCTION AND ITS TRANSFORM 


Suppose we have a function of a real variable ¢ defined for tœ 0 
[we shall sometimes consider that the function f(t) is defined on 
an infinite interval — œo < £ < œ, but f (t)=0 when ¢<0]. We 
shall assume that the function f(t) is piecewise continuous, that is, 
such that in any finite interval it has a finite number of discon- 
tinuities of the first kind (see Sec. 2.9, Vol. I). To ensure the 
existence of certain integrals in the infinite interval O0<t < oo we 
impose an additional restriction on the function f(t): namely, we 
suppose that there exist constant positive numbers M and s, such 
that 


IFE] < Mest (1) 


for any value ¢ in the interval 0< £< o0. 

Let us consider the product of the function f(t) by the complex 
function e-t of a real variable ** ¢, where p=a-+ib (aœ Q) is 
some complex number: 

e-Ptf (t) (2) 


* The following books are recommended for further study of operational 
calculus: A. I. Lurie, Operational Calculus and Its Applications to Problems 
of Mechanics, Moscow-Leningrad, Gostekhizdat, 1950; V. A. Ditkin and 
P. I. Kuznetsov, Handbook of Operational Calculus, Moscow, Leningrad, 
Gostekhizdat, 1951; V.A. Ditkin and A.P. Prudnikov, Integral Transforma 
tions and Operational Calculus, Fizmatgiz, 1961; Jan G. Mikusiński, Rachu- 
nek operatorów, Warszawa, 1953, (Operational Calculus). 

** See Sec. 7.4, Vol. I, concerning complex functions of a real variable. 
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Function (2) is also a complex function of a real variable ¢: 
e-rtf (t) = en (at tent (t) Es e-f (t) eiit 
=e" (t) cos bt —ie~*'f (t) sin bt 


Let us further consider the improper integral 


o oO 


\ e-Ptf (t) dt = | e-etf (t) cosbt dt—i | e-*'f (t)sinbtdt (3) 
0 0 0 

We shall show that if the function f(t) satisfied condition (1) and 
a> S» then the integrals on the right of (3) exist and the con- 
vergence of the integrals is absolute. We begin by evaluating the 
first of these integrals: 

< | |e~*#f (t) cos bt | dt 


f e~2f (t) cos bt dt 
0 0 


M 


a—-So 


<M f e~*tesst dt = M f e- (4-5) t dt = 
0 0 


In similar fashion we evaluate the second integral. Thus, the in- 
tegral \ e-rtf (t) dt exist. It defines a certain function of p, which 


0 

we denote* by F(p): 

F (p) =| e-*f (t) di (4) 

ò 

The function F (p) is called the Laplace transform, or the L-trans- 
form, or simply the transform of the function f(t). The function 
f(t) is known as the original function. If F(p) is the transform 
of f(t), then we write 


F (p) > f(t) (5) 

or 
f(t) < F (p) (6) 

or 
L {f (t)} =F (p) (7) 


As we shall presently see, with the help of transforms it is pos- 
sible to simplify the solution of many problems, for instance, to 
reduce the solution of differential equations to simple algebraic 


* The function F (p), for p #0, is a function of a complex variable (for 
example, see V. I. Smirnov’s Course of Higher Mathematics, Vol. III, Part 2, 
in Russian). The transformation (4) is similar to the Fourier transformation consi- 
dered in Sec. 5.14. 
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operations in finding a transform. Knowing the transform one can 
find the original function either from specially prepared “original 
function-transform” tables or by methods that will be given below. 
Certain natural questions arise. 

Let there be given a certain function F (p). Does there exist a 
function f(t) for which F(p) is a transform? If there does, then 
is this function the only one? The answer is yes to both ques- 
tions, given certain definite assumptions with respect to F (p) and 
f(t). For example, the following theorem, which we give without 
proof, establishes that the transform is unique: 

Uniqueness Theorem. /f two continuous functions ọ (t) and yp (t) 
have one and the same L-transform F (p), then these functions are 
identically equal. 

This theorem will play an important role throughout the subse- 
quent text. Indeed, if in the solution of some practical problem 
we have in some way determined the transform of the desired 
function, and from the transform the original function, then on 
the basis of the foregoing theorem we conclude that the function 
we have found is the solution of the given problem and that no 
other solutions exist. 


7.2 TRANSFORMS OF THE FUNCTIONS o, (¢), sin¢, cost 


1. The function f(t), defined as 
f(j=1 for ¢>0 
f()=0 for #<0 

is called the Heaviside unit function and is denoted ny o, (t). The 
graph of this function is given in Fig. 148. 


Let us find the L-transform of the Heavi- 
side function: 


ae a 
Laie je "d= = 
Thus,* 
1 
1 ry (1) 
or, more precisely, 

ae | 
0, (t)* 


o 
* In computing the integral f e-Pt at it is possible to represent it as the 


0 
sum of integrals of real functions; the same result would be obtained. This also 
holds for the next two integrals. 
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In some books on operational calculus the following expression 
is calléd the transform of the function f(t): 


F*(p)=p j e-Pt} (t) dt 


With this definition we have o,(t)< 1 and, consequently, C+C, 
more exactly, Co, (t)+ C. 
II. Let f(¢)=sin¢; then 


© 


Lisin th = Verrtsin tdt Fae 21 


p?+1 o p+ 
And so 
sint + (2) 


pP+I 
III, Let f(t)=cos t; then 


G _e-P* (sin t—p cos t) _— p 
Lios} = fe P cos t dt = 5-7 PET 
Thus, 
cost + ia (3) 


7.3 THE TRANSFORM OF A FUNCTION WITH CHANGED 
SCALE OF THE INDEPENDENT VARIABLE. 
TRANSFORMS OF THE FUNCTIONS sinat, cos at 


Let us consider the transform of the function f (at), where a > 0: 


O 


L{f (at)} = | e77} (at) dt 


0 


We change the variable in the integral, putting z=at; hence, 
dz=adt; then we get 


L{f(a}=4le * Fede 
or S 


L{f (at)}= > F (2) 
F (p) + F(t) 
zF(2) > f (at) (1) 


Thus, if 
then 
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Example 1. From (2) of Sec. 7.2, by (1), we straightway get 
F 1 1 
sin at a Po Vern aan 
(EH 
a 
pHa? @) 
Example 2. From (3), Sec. 7.2, by (1), we obtain 


or 


sin at + 


or 


er 3) 


7.4 THE LINEARITY PROPERTY OF A TRANSFORM 


Theorem. The transform of a sum of several functions multiplied 
by constants is equal to the sum of the transforms of these func- 
tions multiplied by the corresponding constants, that is, if 


FO=2 Cho (1) 
(C; are constants) and z 


F (p) > f(t), Fi (p) > fF: (4) 
then 


F(p)= C;F; (p) (1’) 


Proof. Multiplying all the terms of (1) by e-?? and integrating 
with respect to ¢ from 0 to oo (taking the factors C; outside the 
integral sign), we get (1’). 

Example 1. Find the transform of the function 

Í (t) =3 sin 4t —2 cos 5t 
Solution. Applying formulas (2), (3), Sec. 7.3, and (1’), we have 


LIO =3 t an e aE 


P+? Pep LIS pL 
Example 2. Find the original function whose transform is expressed by the 
formula 


Solution. We represent £ (p) as 


a) 2 p 
FOST papat TGR 
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Hence, by (2), (3), Sec. 7.3, and (1’), we have 

t= sin 2¢ +20 cos 3¢ 
From the uniqueness theorem, Sec. 7.1, it follows that this is the only original 
function that corresponds to the given F (p). 

7.5 THE SHIFT THEOREM 


Theorem. /f F(p) is the transform of the function f(t), then 
F(p-+a) is the transform of the function e-*'f (t), that is, 
if F(p) > F(t) 
then F (p-+-a) + e-% f (t) 
{It is assumed here that Re(p+a) >s] 
Proof. Find the transform of the function e-@‘f (t): 


(1) 


L {e-% f (t)} = f e-t-atf (t) dt = f e-P+a) tf (t) dt 
Thus, ' 
L {e-*F (t)} =F (p +a) 


This theorem makes it possible to expand considerably the class 
of transforms for which it is easy to find the original functions. 


7.6 TRANSFORMS OF THE FUNCTIONS e-“ sinhat, coshat, 
e-“ sinat, e-%* cosat 


From (1) (Sec. 7.2, on the basis of (1), Sec. 7.5, we straight- 
way get 

Lo 

pae~ ) 


1. ; 
er ae (1’) 


Similarly, 


Subtracting from the terms of (1’) the corresponding terms of (1) 
and dividing the results by two, we get 


l 1 1 zal 
2 (= ata) eo) (ext ea) 
or ' 


aa ++ sinh at (2) 


Similarly, by adding (1) and (1’), we obtain 
— cosh at (3) 


pan ae, 
p?—a?- 
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From (2), Sec 7.3, by (1), Sec. 7.5, we have 


pe a es t 
praa ce at sin i (4) 
From (3), Sec. 7.3, by (1), Sec. 7.5, we e get 
pa 
(P+a)} +a? 
Example 1. Find the original function whose transform is given by the 
formula 


+ e-% cos at (5) 


7 
F o= RT Top Tal 


Solution. Transform F (p) to the form of the expression on the left-hand 
side of (4): j 
7 4 


pF l0p+41 Ra 6 4 pF FE 
Thus 


F (p)= 


Hence, by formula (4) we will have 


2 PFT 


F (p) +e- sin 4¢ 


Example 2. Find the original function whose transform is given by the 
formula 


—__ P+3 
o= ataO 
Solution. Transform the function F (p): 


pP+3 _(P+)+2__ p+! 
P+2p+10 (p+1)?+9 — gr : 


HEFTA EFS HS TTR 
Using formulas (4) and (5), we find the original function: 


F (p) — e-t cos 3t +5 e-t sin 3t 


7.7 DIFFERENTIATION OF TRANSFORMS 
Theorem. /f F (p)— f(t), ise 


(D Fe F (p) EF) (1) 


Proof. We first prove that if f (t) satisfies condition (1), Sec. 7.1, 
then the integral 


| e=Pt (—1)" f(t) dt (2) 
exists. o 
27— 2082 
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By hypothesis, |f(t)|< Mest, p=a+ib, a>s,; and a>0, 
So > 0. Obviously, there will be an e œ> O such that the inequality 
a>s,+e will be fulfilled. As in Sec. 7.1, it is proved that the 
following integral exists: 


{ e~t- 1] F(t) |dt 


0 
We then evaluate the integral (2) 


Í [e-ettnf (t) Jat = e-O-2) te-et emf (t)| dt 
: ò 


Since the function e-®¢" is bounded and, in absolute value, is 
less than some number N for any value ¢ >0, we can write 
| Leten (t)|dt < NS Je-@-e F(t) | dt =N § e- 0-2] F(t) |dt <00 
0 0 0 

It is thus proved that the integral (2) exists. But this integral 


may be regarded as an nth-order derivative with respect to the 
parameter * p of the integral 


È e-P'f (t) dé 
0 


And so, from formula 


F (p) = | e-f (1) dt 
0 


we get the formula 
nA t n 2 ee t 
f emrt (—A" F (A) dt =z f eF A) dt 
0 ò 

From these two equations we have 


(—1)" Fa F (p) = È e-rtni (t) 
0 


which is formula (1). 
Let us use (2) to find the transform of a power function. We 
write the formula (1), Sec. 7.2: 


—> 1 


* Earlier we found a formula for differentiating a definite integral with res- 
pect to a real parameter (see Sec. 11.10, Vol. I). Here, the parameter p is a 
complex number, but the differentiation formula holds true. 
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7.8 The Transforms of Derivatives 
Using formula (1) of this section, from this formula we get 


Cng) h 


or 
1. 
pert 
Similarly 
aot 
For any n we have 
nal. 
past t" (3) 
Example 1. From the formula [see (2), Sec. 7.3] 
o 
Ta = (enw sin at dt 
i 0 
by differentiating the left and right sides with respect to the parameter p, 
we get 
2pa : A 
TET >t sin at (4) 
Example 2. From (3), Sec. 7.3, on the basis of (1), we have 
a—p . 
e cos at (5) 
Example 3. From (1), Sec. 7.6, by (1), we have 
l č . at 
orate ®) 


7.8 THE TRANSFORMS OF DERIVATIVES 


Theorem. /f F (p)— f(t), then 
pF (p)—F (0) => F (t) (1) 


Proof. From the definition of a transform we can write 
L{f ()}=§ e-r} (t) dt (2) 
0 


We shall assume that all the derivatives f(t), F(t), ..., F™ (t) 


which we encounter satisfy the condition (1), Sec. 7.1, and, con- 
sequently, the integral (2) and similar integrals for subsequent 
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derivatives exist. Computing by parts the integral on the right 
of (2), we find 


oO 


Lif (h= f eiF dt = ePi l + lene (tdt 


0 
But by condition (1), Sec. 7.1, 
lim e-?tf (t)=0 
too 


and 


| e-F'f (t) dé = F (p) 
0 
Therefore 
L {f' (t)} = — F 0) + pF (p) 


The theorem is proved. Let us now consider the transforms of 
derivatives of any order. Substituting into (1) the expression 
pF (p)—f (0) in place of F(p) and the expression f’ (t) in place 


of f(t), we get 
P [pF (p) —f (0)]—F’ (0) == f” (t) 
or, removing brackets, 
PF (p)— pf (0)—f (0) => F" (t) (3) 
The transform for a derivative of order n will be 
p"F (p)— [p= (0) + p*~?f' (0) +... 


+ phi" (0) +f" (O)] H+ F(t (4) 
Note. Formulas (1), (3), and (4) are simplified if f(0)= f (0) = 
=...=/"-)(0)=0. In this case we get 
F (p) +f (t) 
pF (p) >F (t) 
p”F (p) — f (£) 


7.9 TABLE OF TRANSFORMS 


For convenience, the transforms which we obtained are here 
given in the form of a table. 
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Mm 


F m= e~ Ptr (h dt 
0 


L 

p 

a 
p+ a? 

p 


sinh at 


p— g? cosh at 
a — . 
VETI e7% sinat 
ae e~%! cos at 
(p-+a)?+ a? 
n! jn 
pai 
aes t sin at 
(p? +a)? 
Pe t cos at 
(p° + a)? 
= tenet 
(e+ a)? 
1 eae 
(ait ggs (sin at —at cos at) 
(I a F (p) inf (t) 
t 
F: (p) Fa (P) f fa (T) Fa (¢—1) dt 
ò 


Note. Formulas 13 and 15 of this table will be derived later on. 
If for the transform of the function f(t) we take 


ao 


F ()=p | e-Ptf (t) de 


then in the formulas 1-13 of the table the expressions in the first 
column must be multiplied by p (formulas 14 and 15 will change 
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more fundamentally). Since F*(p)=pF(p), it follows tal _ by 
substituting into the left side of formula 14 the expression Z2 e F” p) 


in place of F(p) and multiplying by p, we get 
, F n 
14 Chega (SO) ero 
Substituting into the left side of formula 15 


F,(p)= eee) F, (p) = Tia 
and multiplying this ia by p, we have, 
t 


15’ SFL) Fip) >| A) hr) de 
0 


7.10 AN AUXILIARY EQUATION FOR A GIVEN 
DIFFERENTIAL EQUATION 


Suppose we have a linear differential equation of order n with 
constant coefficients a), a,, ..., G,-4, ss 


aoe a, tay, Z4a,x (1) =F (t) (1) 


It is required to find a solution of this equation x= x (t) for ¢>0 
that satisfies the initial conditions 


x (0) = Xps x’ (0) = Xos Say xian (0) = xa» (2) 


Before, we solved this problem as follows: we found the general 
solution of equation (1) containing n arbitrary constants; then we 
determined the constants so that they should satisfy the initial 
conditions (2). 

Here we give a simpler method of solving this problem using 
operational calculus. We seek the L-transform of the solution x (£) 
of (1) satisfying the conditions (2). We designate this L-transform 
by x(p); thus, % (p) +x (0). 

Let us suppose that there exist transforms of the solution of (1) 
and of its derivatives up to order n inclusive (after finding the 
solution we can test the truth of this assumption). We multiply 
all terms of (1) by e-?', where p=a-+ib, and integrate with res- 
pect to ¢ from 0 to ov: 


R _ dng ort 
afe nial +a, fe ne dt + 


+... +a, Ve-rtx (t) dt = ( e-r} (t)dt (3) 
0 


0 
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On the left-hand side of the equation are the L-transforms of the 
function x(t) and its derivatives, on the right, the L-transform of 
the function f(t), which we denote by F(p). Hence, equation (3) 
may be rewritten as 


al {Fah bal {iret f + Lal {x(Q}=L {FO} 


Substituting into this equation the expressions (1), (3), and (4), 
Sec. 7.8, in place of the transforms of the function and of its 
derivatives, we get 


a, {p"x (p)—[p"-*X_ + p”? + p"—2xg +... + xg" ]} 
+a, {p?-4x (p) — [p"=*x,-+ p". xD] 
+a,- {px (p)—Xo} + anx (P) = F (p) (4) 
Equation (4) is known as the auxiliary equation, or the transform 
equation. The unknown in this equation is the transform x (p), 
which is determined from it. Transform it leaving on the left the 
terms that contain x (p): 


X (p) [aop" +,p" +... +4,-.p + an] 
= Ay [p™— + p"? nn Ha] 
+a, [P7k +p" n e] 


+an-a [PX + Xo] +aân-1x0 +F (p) (4’) 


The coefficient of x(p) on the left of (4’) is an nth-degree poly- 
nomial in p, which results when in place of the derivatives we 
put the corresponding powers of p into the left-hand member of 
equation (1). We denote the polynomial by q, (p): 
Pn (P) =op” +a, pP” +... + an-1P +a, (5) 

The right-hand side of (4’) is formed as follows: 

the coefficient a,_, is multiplied by x, 

the coefficient a,_, is multiplied by px, + xo, 

the coefficient a, is multiplied by p"~?x,+p"-3xj+... +x" 

the coefficient a, is multiplied by p"-!x,+ p"~?x,+ ... + xf") 


All these products are combined. To this is also added the transform 
of the right side of the differential equation F(p). All terms of 
the right side of (4’), with the exception of F(p), form, after 
collecting like terms, a polynomial in p of degree n—1 with 
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known coefficients. We denote it by p„-, (p). And so equation (4’) 
can be written as follows: 


xX (P) Pn (P)="bn-1 (P) +F (p) 
From this equation we determine x (p): 


Zim — pn-1(P) F (p) 
x(p) = Pn (P) Pn (P) (6) 


Determined in this way, x(p) is the transform of the solution 
x(t) of the equation (1), which solution satisfies the initial con- 
ditions (2). If we now find the function x* (t) whose transform is 
the function x (p) determined by equation (6), then, by the uni- 
queness theorem formulated in Sec. 7.1, it will follow that x*(¢) 
is the solution of equation (1) that satisfies the conditions (2), 
that is, 


x*(t)=x(t) 

If we seek the solution of (1) for zero initial conditions: 
Xp = X= X=... = XED =0, then in (6) we will have ,_,(p)=0 
and the equation will take the form 

Fp) £P 
xP) = oo) 
or E 
E D A ne 


ap" +-a,p"-l+ .,. +a, 
Example 1, Find the solution of the equation 
dx 
aoe! 
satisfying the initial conditions x=0 when ¢=0. 
Solution. Form the auxiliary equation 
= 1 = 1 
x (p): 1)=0+— or x(p)=———— 
PPT Ore P= pF 


Decomposing the fraction on the right into partial fractions, we get 
1 
p+1 
Using formulas 1 and 4 of the table, we find the solution: 
x(t)=1—e-t 
Example 2. Find the solution of the equation 


dx 
qr t=! 


z0)=5-— 


that satisfies the initial conditions: Xo =x, =0 for ¢=0. 
Solution. Write the auxiliary equation (4’) 


x (P) +=} or A= Ty 


7.10 An Auxiliary Equation for a Given Differential Equation 


Decomposing this fraction into partial fractions, we get 


Using formulas 1 and 3 of the table we find the solution: 


x(t)= -4 cos 3ć +5 


Example 3. Find the solution of the equation 
d?x dx 
ae t? g teat 


that satisfies the initial conditions: xa =xọ=0 for ¢=0. 
Solution. Write the auxiliary equation (4’) 


# (p) (0 + 3p-+2)= -r 


or 
- 1 1 1 
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Decomposing this fractton into partial fractions by the method of undetermined 


coefficients, we obtain 
= 1 1 3 1l 1 1. 
*PO=9 Fp tpt Feta 
From formulas 9, 1 and 4 of the table we find the solution: 
li e-t le-zt 
x)=7t -gte 7 e 
Example 4. Find the solution of the equation 
d?x dx x 
at? a T= sin t 


satisfying the initial conditions x= 1, xo=2 for t=0. 
Solution. Write the auxiliary equation (4’): 


x (P) (p?+2p+5)=p-1+2+2-144 {sin t} 
or 


Z(M ++ =p +4 +T 


whence we find x (p): 


Sie l 
s= Faroe Te Fop Ps) 


Decomposing the latter fraction on the right into partial fractions, we can write 


11 1 1 
e Tett -0t 
P= aF AFI 
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or 
0-5 DEH EET OS GE FET TE ET 


Applying formulas J 7, 3, and 2 of the table, we gi the solution 


x =i M feos 2t-+ 28 e-t sin a—t 0 cost sin t 


1 
or, finally, 


x(t)=e-t (5 cos 243 5 sin 2t )— b cos t+ sin £ 


7.11 DECOMPOSITION THEOREM 


From formula (6) of the previous section it follows that the 
transform of the solution of a linear differential equation consists 
of two terms: the first term is a proper rational fraction in p, the 
second term is a fraction whose numerator is the transform of the 
right side of the equation F(p), while the denominator is the 
polynomial ọ,„(p). If F(p) is a rational fraction, then the second 
term will also be a rational fraction. It is thus necessary to be 
able to find the original function whose transform is the proper 
rational fraction. We shall deal with this question in the present 
section. Let the L-transform of some function be a proper rational 
fraction in p: 

Sbn-1(P) 
Pn (P) 
It is required to find the original function. In Sec. 10.7, Vol. I, 
it was shown that any proper rational fraction may be represented 
in the form of a sum of partial fractions of four types: 
A 
I, — 
p—a 

4 
(p—a)k 

Ap-+B 
Pit apta’ 
that is, 4+—a, <0; 

Ap+B 
IV. ——++—__ 
PEPEE where k>2, the roots of the denominator 
are complex. 
Let us find the original functions for these partial fractions. 


oD type I fraction we get (on the basis of formula 4 of the 
able 


’ 


HI. where the roots in the denominator are complex, 


pa — Aest 
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For a type II fraction, by formulas 9 and 4 of the table, we have 


A š 1 i 
or Ga (1) 


Let us now consider a type III fraction. We perform identity 
transformations: 


Ap+B _ _ Ap+B 

P+Haptas, (o+4 + +(V aa 
_ A(p+$)+(2—4) p+% 
NV N 


Denoting the first and second terms by M and N, respectively, 
we get (from formulas 8 and 7 of the table) 


-24 a 
M= Ae ? cost &—> 


And, finally, 


Ap+B 
p*-+a,p+ a, 
a 
oo at B-17 : f a} 
->e Acos t a,— F tiin! V a — E (2) 
ay 


We shall not consider a type IV partial fraction, since it would 
involve considerable calculations. We shall consider certain special 
cases below. For further information see the list of books at the 
beginning of this chapter. 
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7.12 EXAMPLES OF SOLUTIONS OF DIFFERENTIAL EQUATIONS 
AND SYSTEMS OF DIFFERENTIAL EQUATIONS 
BY THE OPERATIONAL METHOD 


Example 1. Find the solution of the equation 
oie sin 3x 


that satisfies the initial conditions: x»=0, x» =0 when ¢=0. 
Solution. Form the auxiliary equation 


z 3 - 3 
sP +t Trg? O= FNA 
or 
_ 3 3 
5 5 1 3 3 2 
x (p)= aay aa a4 4 See pe+9 Tir. p+4 


whence we get the solution 


3 l. 
x= sin 2t — —g sin 3t 


Example 2. Find the solution of the equation 
Bx 
aa tt=0 
that satisfies the initial conditions: x»=1, x Xo =3, Xo =8 when t=0. 
Solution. Forming the auxiliary equation 
x (p) (p> +1) =p?-1+p-348 
we find 
€ (py oes = p?+3p+8 
P+ (p+l) pti) 
Decomposing the j fraction obtained into partial fractions, we get 


p?+3p+8 oe a eee —p+é6 
(P+1)(p?—p+!) = p?—p+l 


—— + — H Va 


p+! 1\2, / V3? 
sg) í Viy ” Pea) HT) 
Using Table of Transforms (Sec. 7.9), we write the solution: 
1 
=>! 
x (t)=2e-t+e? (- cos rth s sin 13, r) 
Example 3. Find the solution of the equation 
2 
Siteat cos 2? 


that satisfies the initial conditions: x=0, x»=0 when ¢=0. 
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Solution. Write the auxiliary peat 
8 
2+1 
x (p) (P + )= st (F4 

whence, after some manipulating, we get 

- 5 1 5 1 8 l 

*O=—9 PET To PFE TS TH 
Consequently, 


x(t)= = 3 sint +5 sin 2¢+— 1E sin 2¢—t cos 2t ) 


Obviously, the operational method may also be used to solve systems of linear 
differential equations. The following is an illustration. 
Example 4. Find the solution of the set of equations 


d opta 
taata 
dx dy = 
det ge se" 


that satisfies the initial conditions: x =0, y =0 when ¢=0. 


Solution. We denote x (t)«—x (p), y(¢)+—y(p) and write the system of 
auxiliary equations: 


(8p +2) (9) +9 = 


px (p) + (4p +3) y (p) = 
Solving this system, we find 
4p +3 1 l 33 


“O= FUP 29 SPF UPF 


ries 1 _il ( 1 li ) 
P= Tp For!) 5 \ pri IpF6 
From the transforms we find the original functions, i.e., the sought-for solutions 


of the system: 
6 
l -i t 
= | e-t — 
y (t) 5 (. e ) 


Linear systems of higher orders are solved in similar fashion. 


7.13 THE CONVOLUTION THEOREM 


The following convolution theorem is frequently useful when 
solving differential equations by the operational method. 

Convolution Theorem. /f F, (p) and F,(p) are the transforms of 
the functions f, (t) and f,(t), that is, 


F, (p) +f, (t) and F, (p) +f, (i) 
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then F,(p)-F,(p) is the transform of the function 


t 
Sf (t) fa (t—1) dt 


that is, ; 


F, (p) F, (P) + Sf, Of (t—1) dr (1) 


0 


Proof. We find the transform of the function 


t 
Sf (t) fa (£—1) de 


from the definition of a transform: 


L fi fi) fa (t— 1) ax} = {er | f, (5) fa (t— 1) a| dt 
0 0 0 


The integral on the right is a twofold iterated 
integral of the form f f @ (t, t) dt dt, which 
D 
is taken over a region bounded by the straight 


lines t=0, t=? (Fig. 149). Changing the 
order of integration in this integral, we get 


t œ ao 
L f; fy (t) fa (=) ar) =f [r (t) § e-Pt f, (t—1) | dr 
0 0 T 


Changing the variable ‘—t=z in the inner integral, we obtain 


o 


f e7P! f, (t—t)dt = f e-~? (2+) f, (z) dz =e-P" f e-P? f, (z)dz=e-""F, (p) 


0 0 


Hence, 


t e] 
L fi f (0) fh (t— 1) ar) = f f, (t) e-P*F; (p) de 


=F, (p) f e-P*f, (t) dt = F, (p) F, (p) 


And so 
f fy (1) fa (1—1) dt F, (p) F, (p) 
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This is formula 15 of Table of Transforms (see Sec. 7.9). 


Note 1. The expression f hif (¢—1) dt is called the convolu- 
lion (Faltung, resultant) of IW functions f, (¢) and f,(t). The ope- 


ration of obtaining it is also known as the convolution of two 
functions; here 


t t 
Sf (t) fa (a) ae= f h (t— 7) fa (1) de 


That this equation is true is evident if we make the change of 
variable ¿—qt=z in the right-hand integral. 


Example. Find the solution to the equation 


a H= (A) 


that satisfies the initial conditions: x =xọ=0 for t =0. 
Solution. Write the auxiliary equation 


x (p) (+1) =F (p) 
where F (p) is the transform of the function f (t). Hence, 


x(p)= F (p), but 


+ sin t and F (p) — f(t). 


TES P+! 


Applying the convolution formula (1) and denoting ar =F; (p), F (p)=F (p), 


we get 
t 


x(t) =f f (x) sin (t — 1) dt (2) 
0 


Note 2. On the basis of the convolution theorem it is easy to 
find the transform of the integral of the given function if we 
know the transform of this function; namely, if F (p)— f (t), then 


t 
1 ae. 
oF (py f f(x) de (3) 
Indeed, if we denote 
AW®=F@,. f@)=1, then F,(P)=F(p), F,(P)=} 
Putting these functions into (1), we get formula (3). 
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7.14 THE DIFFERENTIAL EQUATIONS OF MECHANICAL 
VIBRATIONS. THE DIFFERENTIAL EQUATIONS 
OF ELECTRIC-CIRCUIT THEORY 


From mechanics we know that the vibrations of a material point 
of mass m are described by the equation * 


oe AGE mh) (1) 


where x is the deflection of the point from a certain position 
and k is the rigidity of the elastic system, for instance, a spring 
(a car spring), the force of resistance to motion is proportional 


c i (the proportionality constant is A) to the first 
power of the velocity, and f, (t) is the outer (or 

p disturbing) force. 
E R Equations of type (1) describe small vibra- 


tions of other mechanical systems with one deg- 

a ree of freedom, for example, the torsional vib- 

<i rations of a flywheel on an elastic shaft, if x is 

Fig. 150 the angle of rotation of the flywheel, m is the 

moment of inertia of the flywheel, k is the 

torsional rigidity of the shaft, and mf, (t) is the moment of the 

outer forces relative to the axis of rotation. Equations of type 

(1) describe: not only mechanical vibrations but also phenomena 

that occur in electric circuits. . 

Suppose we have an electric circuit consisting of an inductance L, 

a resistance R and a capacitance C, to which is applied an emf E 

(Fig. 150). We denote by i the current in the circuit, by Q the 

charge of the capacitor; then, as we know from electrical engi- 
neering, i and Q satisfy the following equations: 


di ae 
LatRi+GaE (2) 
dQ_, 
ao! (3) 
From (3) we get 
dQ di 3 
de Sdi (3) 


Substituting (3) and (3’) into (2), we get for Q an equation of 
type (1): is k 

d d 1 

a tRatcQ=F (4) 


* See, for example, Sec. 1.26, where such an equation is derived in consi- 
dering the vibration of a weight on a car spring. 
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Differentiating both sides of (2) and utilizing (3), we obtain an 
equation for determining the current i: 


dE 


di di be 

Laat Ratcinag (9) 

Equations (4) and (5) are type (1) equations. 
7.15 SOLUTION OF THE DIFFERENTIAL EQUATION 
OF OSCILLATIONS 
Let us write the oscillation equation in the form 
d? d. 
T tag +ax= f (t) (1) 


where the mechanical and physical meaning of the desired func- 

tion x, of the coefficients a,, a, and of the function f (t) is readily 

established by comparing this equation with equations (1), (4), 

(5) of the preceding section. Let us find the solution to equation 

(1) that satisfies the initial conditions x= x, x’=x, when t=0. 
We form the auxiliary equation for equation (1): 


x (p) (P? + aP +.4,) = xop + xo +-a4% + F (Pp) (2) 
where F(p) is the transform of the function f(t). From (2) we find 


= ip) — ZP +o tato F (p) 
naa PFapta | Fapta (3) 


Thus, for a solution Q(t) of equation (4), Sec. 7.14, that satisfies 
the initial conditions Q=Q,, Q’=Q, when ¢=0, the transform 
will have the form 


= L 0 E 
Op) = (Qep+ Qo)-+ RQ a; (p) 
Lp?+ Rp+o Lp?+ Rp +e 


The type of solution is significantly dependent un whether the roots 
of the trinomial p?+a,p +a, are complex, or real and distinct, 
or real and equal. Let us examine in detail the case. where the 
roots of the trinomial are complex, that is, when ay —a,<0. 
The other cases are considered in similar fashion. 

Since the transform of a sum of two functions is equal to the 
sum of their transforms, it follows from formula (2), Sec. 7.11, 


that the original function for the first fraction on the right of (3) 
28—2082 
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will have the form 
= 


r 
xop +x Xo. -= 
oP txota . 


= Xo cos £ a, — > 
PH ap +H aa 4 a 


Let us then find the original function corresponding to the fraction 


F (p) 
p?+ap +a, 


Here, we take advantage of the convolution theorem, first noting 
that 


ay 
-t 
1 . e ? 


a Sete ee ae) ai <a 
Fra a int VW, FOE 
a, — 


4 
Hence, from (1), Sec. 7.13, we get 


t 
__ Fp) - [ 
pPfap+a, - 

1 2 a ay 


And so, from (3), taking into account (4) and (5), we get 


Faye? sint Va, — Fax (6) 


T Xol 


JE xo g” 
xa cos t V a= 
Vai ae 


sgar? 2 


= 
fo as 
—== sint yV aF 


a 


: a A 2 

a (7 Me sin¢—yV aid 
Vaa 0 

If the external force f(t)=0, which means that if we have free 

mechanical or electrical oscillations, then the solution is given by 

the first term on the right-hand side of expression (6). If the ini- 

tial data are equal to zero, i.e., if x»=x,—=0, then the solution 


is given by the second term on the right side of (6). Let us con- 
sider these cases in more detail. 
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7.16 INVESTIGATING FREE OSCILLATIONS 


Let equation (1) of the preceding section describe free oscillations, 
that is, f(t)=0. For convenience in writing we introduce the 
notation a,=2n, a,=k?, k?=k?—n?*. Then it will have the form 


d? dx 
Hn F +kx=0 (1) 


The solution of this equation x,, that satisfies the initial condi- 
tions x= X, x’=x, for t=0 is given by the formula (4), Sec. 7.15, 
or by the first term of (6): 


xy (t)= em'| x cos k,t + ap sin k,t | (2) 
We denote x, =a, Xo+*o _ 4 It is obvious that for any a and b 


we can select M and ô such that the following equalities will be 
fulfilled: 

a=Msin§, b=Mcosd 
here, 

M? =0@ +b, tanô=4 


We rewrite formula (2) as 
Xp =e7"t [M cos k,t sin ô+ M sin k,t cos ô] 
or, in final form, the solution may be written thus: 
Xy =V a +b e-”t sin (kt +ô) (3) 


Solution (3) corresponds to damped oscillations. 
If 2n=a =0, that is, if there is no internal friction, then the 
solution will be of the form 


xX; =V @ Fb sin (kt +ô) 


In this case harmonic oscillations occur. (In Sec. 1.27, Fig. 27 
and 29 give graphs of harmonic and damped oscillations.) 


7.17 INVESTIGATING MECHANICAL 
AND ELECTRICAL OSCILLATIONS IN THE CASE 
OF A PERIODIC EXTERNAL FORCE 


When studying elastic vibrations of mechanical systems and, in 
particular, when studying electrical oscillations, one has to consider 
different types of external force f(t). Let us consider in detail the 
case of a periodic external force. Let equation (1), Sec. 7.15, have 
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the form 
Px 4 on + ky = Asin of (1) 
To determine the nature of the motion it is sufficient to consider 
the case when x,=x,=0. One could obtain the solution of the 
equation by formula (6), Sec. 7.15, but we obtain the solution by 
carrying out all the intermediate calculations. 
Let us write the transform equation 


x (p) (P? + 2np +k°) = A Fg 


from which we get 
= Ao 
x (P) = Rp EROS @) 


We consider the case when 2n 0 (n? < k?). Decompose the frac- 
tion on the right into partial fractions: 


Aw _ Np+B ERED 3 

(p? + 2np+ k*) (?+0?)  p?+2rp+k? © p?+o? (3) 
We determine the constants B, C, D, N by the method of unde- 
termined coefficients. Using formula (2), Sec. 7.11, and (2) of this 
section, we find the original function: 


x(t) = PETT { (k? — œ?) sin wf — 2nw cos wt 


emnt | (2nt— k++ wt) £ sin kyt-+ 2no cos kat] } (4) 


here again, k, =V k?—n?. This is the solution of equation (1) that 
satisfies the initial conditions x,=x,—0 when ¢=:0 

Let us consider a special case when 2n = 0. This corresponds to 
a mechanical system with no internal resistance (no damper), or to 
an electric circuit where R=O (no internal resistance in the cir- 
cuit). Equation (1) then takes the form 


a +k?x = Asin ot (5) 


and we get the solution of this equation satisfying the conditions 
Xo =X =0 for ¢=0 if in (4) we put n=0: 


x(t) =p [—o sin kt + ksin ot] (6) 


Here we have the sum of two harmonic oscillations: natural oscilla- 
tions with frequency &: 
@ 


A : 
Xat = —popz sin kt 
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and forced oscillations with frequency œw: 
x, (t) =z sin wt 


The type of oscillations for the case k®> w is shown in Fig. 151. 
Let us again return to formula (4). If 2n >0 (which occurs in 
the mechanical and electrical systems un- z, 
der consideration), then the term containing 
the factor e-"', which represents. damped 
natural oscillations, rapidly decreases for 
increasing t. For ¢ sufficiently large, the 
character of the oscillations will be deter- 
mined by the term that does not contain 
the factor e~"'; that is, by the term 


A ; 
x (t) => @—o) + Ino {(k? — o?) sin wt 
— 2n o cos wt} (7) 
We introduce the notation Fig. 151 
A (k? — 0?) A.2nw ; 
moy inro M cos ô, -mon Jingi = M sinô (8) 
where 


A 


M = 
V (k? —w?)? + 4n2w? 


The solution (7) may be rewritten as follows: 
A 


e y (1-3) tet 


From formula (9) it follows that the frequency & of forced oscil- 
lations does not coincide with the frequency w of the external force. 
lf the internal resistance, characterized by the number n, is small 
and the frequency œ is not very different from &, then the amplitude 
of oscillations may be made as great as one pleases, since the de- 
nominator may be arbitrarily small. For n=0, wo? =k?, the solution 
is not expressed by formula (9). 


x(t)= 


7.18 SOLVING THE OSCILLATION EQUATION 
IN THE CASE OF RESONANCE 


Let us consider the special case when a,=2n=0, that is, when 
there is no resistance and the frequency of the external force coin- 
cides with that of the natural oscillations, k=. The equation 
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then takes the form 
2 
Ch + kin = Asin kt (i) 
We shall seek the solution that satisfies the initial conditions 
X)=0, xa=0 for ¢=-0. The auxiliary equation will be 
= k 
x (p) (p* +k’) = A ayi 
whence A 
= k 
x (P) = Gare (2) 
We have a proper rational fraction of type IV, which we have not 
considered in the general form. To find the original function for 


the transform (2), we take advantage of the following procedure. 
We write the identity (formula 2 of Table of Transforms, Sec. 7.9) 


z + gx f e7" sinkt dt (3) 
0 


We differentiate both sides of this equation with respect to k (the 
integral on the right may be represented in the form of a sum of 
two integrals of a real variable, each of which depends on the 
parameter k): 


œ 


f e=Ptt cos kt dt 
0 


Utilizing (3) we can rewrite this equation. as 


1 2k? 
PFR (PPF 


2k? fer E cos kt—-L sin kt] dt 


ore, z 
Whence it follows directly that 
Ak - Afl 
ppap Tig (= Sin kt—t cos kt) 


from this formula we obtain formula 13 of the table). Thus, the 
lution of equation (1) will be 


x(t) = (pin kt —t cos kt ) (4) 
Let us study the second term of this equation: 
x, (t) = — n t cos kt (4’) 


This quantity is not bounded as ¢ increases. The amplitude of 
oscillations that correspond to formula (4’) increases without bound 
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as ¢ increases without bound. Hence, the amplitude of oscillations 
corresponding to formula (4) also increases without bound. This is 
resonance; it occurs when the frequency of the natural oscillations 
coincides with that of the external force (see also Sec. 1.28, Figs. 
30, 31). 


7.19 THE DELAY THEOREM 


Let a function f(t), for £< 0, be identically equal to zero 
(Fig. 152, a). Then the function f(¢—?,) will be identically zero 
for t < t, (Fig. 152,56). We shall prove a theorem which is known 
as the delay theorem. 


{ 4 


Fig. 192 


Theorem. /f F (p) is the transform of the function f (t), then e-?'o F (p) 
is the transform of the function f(t—t,); that is, if f (t)<—F (p), 
then 

F (t—t,) = e7" F (p) (1) 

Proof. By the definition of a transform we have 


LIFEN =f eP f tt) de 
0 
to C] 


= lem f (t— t) dt + | e-t f (t—t,) dt 
0 to 


The first integral on the right of the equation is zero since f (¢—?,) = 0 
for ¢<¢,. In the last integral we change the variable, putting 
t—t,=2: 


to} 


LAf (t—1,)} = § e-P +10 f (z) dz = e7?! | Pf (2) dz=e-Plo F (p) 
0 0 
Thus, f (t—t,)— e7?to F (p). 


Example. In Sec. 7.2 it was established for the Heaviside unit function that 


. 1 
AO bair 
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It follows, from the theorem that has just been proved, that for the function 
Oo (t —h) depicted in Fig. 153, the L-transform is 


J p-ph 
p 


that is, : 
Oo (t — h) <~ + e-Ph (2) 


7.20 THE DELTA FUNCTION AND ITS TRANSFORM 


We consider the function 


( 0 for t<0 
o, (t, Aea + for0<t<h (M) 
0 for h<t 


depicted in Fig. 154. 

If this function is interpreted as a force acting over a time 
interval from 0 to h and being zero the rest of the time, then, 
clearly, the impulse of this force 


will be equal to unity. 4 (Éh) 
1 
h 
Oj h 
Fig. 153 Fig. 154 


By formulas (1), Sec. 7.2, and (2) of the preceding section, the 
transform of this function is 


1/1 l 
— | —— — e- Ph 
h ( p p° ) 


o, (t, h 2 (=e) 


that is, 


(2) 


In mechanics it is convenient to regard forces acting over very 
brief time intervals as forces acting instantaneously but having 
a finite impulse. For this reason, the function 6(¢) is introduced 
as the limit of the function o,(¢, h) when h— 0: 


5 (t) = lim o, (t, A) (3) 


This function is called the unit impulse function, or the delta 
function. (It should be noted that 6(¢) is not a function in the 
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ordinary meaning of the word; physicists often call 5(t) the Dirac 
function or the Dirac delta function.) 
It is natural to put 
| §()dt=1 (4) 
One also writes 
0 
{ 8(t)dt=1 (5) 
ò 
The function ô (x) finds application not only in mechanics but 
in many divisions of mathematics, in particular in the solution of 
numerous problems involving the equations of mathematical physics. 
Let us consider the action of ô (t) if it is represented as a force. 
We find the solution to the equation 


d? 
= 5(t) (6) 
that satisfies the conditions: s=0, & =0, when ¢ = 0. From (6) we 
find, taking account of (5), 
v= Ga) 8()ar=1 (7) 
0 


for any ¢, in particular for ¢=-0. Hence, by defining ô (x) by the 
equation (3), we can interpret this function as a force imparting 
to a unit mass at time ¢=0 a velocity equal to unity. 

We define the L-transform of the function 6(¢) as the limit of 
the transform of the function o,(¢, h) as h— 0: 


l1—e-Ph_ | 


sanf a 
L {8 (x)}=lim > ET pat 
(here we made use of |’Hospital’s rule for finding a limit). Thus, 
5 (t)+>1 (8) 


We then define the function 5(¢—1#,), which is interpreted as a 
force that instantaneously, at time ¢=¢,, imparts a unit velocity 
to a unit mass. Obviously, on the basis of the delay theorem we 
will have 

8 ({—t,) Let (9) 


As in the case of (5), we can write 


to 
{ 8(¢—t,)dt=1 (10) 
to 
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From the mechanical interpretation of the delta function it fol- 
lows that the presence of the delta function in the right member 
of the equation can be replaced by an appropriate change in the 
initial conditions. We will illustrate this by a simple example. 
Z (th) Suppose we have a differential equation 
i (É. 


T> =f A+ (A) (11) 


with initial conditions x,=0, x,=0 when 
t=0. The auxiliary equation is 


px (p) = F(p)+ 1 (12) 


. F 1 
Fig. 155 x(p) ="? 7 


Using formulas 9 and 15 of the table, we get 


whence 


t 
x)= JFC dt (13) 
0 


We would arrive at the same result if we found the solution to 
the equation 

d2 

Seat) 
with initial conditions x,=0, ,=1, when ¢=0. In this case the 
auxiliary equation would have the form 


p*x (p)—1 = F (p) (14) 
It is equivalent to the auxiliary equation (12) and, hence, the 
solution will coincide with the solution (13). 


In conclusion, we note the following important property of the 
delta function. On the basis of (4) and (5), we can write 


t 
_fo for —oo <t<0 
RCs for 0 <t<o (15) 


In other words, this integral is equal to the Heaviside unit function 
o, (t). Thus, j 
o, (t)= | S(x)dt (16) 


Differentiating the right and left sides of the equation with respect 
to ¢, we get the conditional equation 


oo (t) = 6 (t) (17) 

_ To get at the meaning of (17), let us examine the function 
o, (t, h) shown in Fig. 155. It is clear that 

6, (t, A) =9, (t, h) (18) 
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(with the exception of the points t=0 and £= h). Passing to the 


limit as h— 0 in equation (18), we see that o, (t, h) — o, (t) and 
we write ° 


o, (t, h — ot) as h—0- 


The right member of (18) o, (t, h) — ô (t) as h—+0. Thus, equation 
(18) passes into the conditional equation (17). 


Exercises on Chapter 7 
Find solutions to the following equations for the indicated initial conditions: 


2 
1. iH Tto, x=1, x'=2 for 4=0. Ans. x=4e-t—3e-?t, 


dx dx 
-— — —— = = "= = = | — t 
2. d af 0, x=2, x'=0, x"=1 for t=0. Ans. x=1—t +e. 
dx ` dx a f , 
3. ar Gy t tH), x= Xç, xX’ =x for ¢=0. 
at , 
Ans. rao [xob cos bt + (xo — xoa) sin bt]. 
dx 44 =ebt y=] xy'= = at aty ot 2 oot 
4. TA 3g te ,x=1, x'=2 for i=0. Ans. x=75 ye +3 et, 
5. Fk 4 mtx =a cos nt, X=Xp, x' = Xo for ¢=0. 
Kei 
Ans. Cen nt — cos mt) + x9 cos mt T sin mt. 
dx dx a ye i= = =t l ys__ 42 oy — 
6. ar a , x=0, x’=0 for ¢=0. Ans. x =2e' 3 t8 — {2 2¢ —2, 
OX hope eet yp gta = 
T: Gs t*=5 t%et, x=x'’=x"=0 for ¢=0. 
1 3 1 1 1V3 -~ .tV3\ +t 
— —/ 42 — | et—_ — e-t_ _— as 2. 
Ans. x= z(t 3+5 je oye 3 {cos 7 V 3 sin 3 \. 
t 
8. $F bal, s === 0 for f=0. Ans. x=1—ye-!— £ ecos} r 3 


9. Tof jr=sin t, Xp =x =x =X =0 for <=0. 
Ans. — fet (¢ —2)+-e-# (¢-++2)42sin £]. 
10. Find solutions to the system’ of differential equations 
Gatyat, Fh +e=0 
that satisfy the initial conditions Xo = Yo = Xo =Yo=0 for t=0. 
Ans. x(t)= -5 cos ¢ +4e+t e~t, 


l l 1 
=—— —— et —— e-t 
y(t) g cost 7° 7? +1, 


CHAPTER 8 


ELEMENTS OF THE THEORY OF PROBABILITY 
AND MATHEMATICAL STATISTICS 


Our daily experience in ordinary life, in practical situations, and 
also in scientific investigations constantly supplies us with examples 
of the breakdown of the familiar regularities of strict determinism 
that we are accustomed to. For instance, suppose we wish to know 
how many telephone calls a first-aid station will receive within 
twenty four hours. 

Long-term observations indicate that there is no way of predicting 
the number of such calls. This number is subject to appreciable 
(and, what is more, random) fluctuations. Likewise, the time the 
doctor will have to spend with the patient in each instance is quite 
random. 

Suppose we want to test N machine parts, all items having been 
manufactured under identical conditions and out of the same ma- 
terials. The time from start of testing to their breakdown (failure) 
turns out to be a random quantity subject to an extremely broad 
spread of values. 

In shooting at a target we have what is called shell dispersion. 
The departure of the point of impact of a shell from the centre 
of the target cannot be predicted because it is a random quan- 
tity. 
It is not sufficient merely to indicate the fact of randomness in 
order to make use of a particular phenomenon of nature or to control 
a technological process. We have to learn to evaluate random events 
numerically and predict the course they will take. Such, at the 
present time, are the insistent demands of theoretical and practical 
problems. Two divisions of mathematics are engaged in the solution 
of such problems and in constructing the requisite general mathe- 
matical theory: they are the theory of probability and mathema- 
tical statistics. 

In this chapter we deal with the basic essentials of probability 
theory and mathematical statistics. 
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8.1 RANDOM EVENT. 
RELATIVE FREQUENCY OF A RANDOM EVENT. 
THE PROBABILITY OF AN EVENT. 
THE SUBJECT OF PROBABILITY THEORY 


The basic concept of ‘probability theory is that of a random 
(chance) event. A random event is an event which may occur or 
fail to occur under the realization of a certain set of conditions. 


Example 1. In coin tossing, the occurrence of heads is a random event. 

Example 2. In firing at a target from a particular gun, hitting the target or 
a given area on it is a random event. 

Example 3. In manufacturing a cylinder with a specified diameter of 20 cm, 
errors less than 0.2 mm represent a random event for a given set of production 
conditions. 


Definition 1. The relative frequency p* of a random event A is 
the ratio of the number m* of occurrences of the given event to the 
total number n* of identical trials, in each of which the given 
event could occur or fail to occur. We will write 

P*(A)=pr=% (1) 


n* 


Example 4. Suppose, under identical conditions, we fire 6 sequences of shots 
at a given target: 

in the first sequence there were 5 shots and 2 hits, 

in the second sequence there were 10 shots and 6 hits, 

in the third sequence there were 12 shots and 7 hits, 

in the fourth sequence there were 50 shots and 27 hits, 

in the fifth sequence there were 100 shots and 49 hits, 

in the sixth sequence there were 200 shots and 102 hits. 

Event A is a hit. The relative frequency of hits in the sequences will be 


first, 2 =0.40, 
second o 60 
ma |) Sma 
third To 58 
A LI nT 
fourth, ZT =0.54, 
49 
fifth, 00 = 0-49 
. 102 
sixth, z075. 


From observations of a variety of phenomena, we can conclude 
that- if the number of trials in each sequence is small, then the 
relative frequencies of the occurrence of event A in the different 
sequences can differ substantially from one another, However, if 
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the number of trials in the sequences is. great, then, as a rule, the 
relative frequencies of the occurrence of event A in different sequ- 
ences will differ but slightly, and the difference is the smaller, the 
greater the number of trials in the sequences. We say that the rela- 
tive frequency in a large number of trials ceases more and more to be 
accidental (of a random nature). However, it must be noted that 
there are events the relative frequency of which is not stable and 
may experience considerable fluctuations even in sequences with a 
large number of trials. 

Experiments show that in most cases there is a constant p such 
that the relative frequencies of occurrence of an event A, given a 
large number of trials, differ but slightly from p, except in rare cases. 

This experimental fact is symbolized as follows: 

m* 


a pP (2) 


The number p is called the probability of occurrence of a ran- 
dom event A. This statement is symbolized as 


P(A)=p (3) 


The probability p is an objective characteristic of the possibi- 
lity of occurrence of event A under given trials. It is determined by 
the nature of A. 

Given a large number of trials, the relative frequency differs 
very slightly from the probability, except in rare cases, which may 
be ignored. 

Relation (2) can be formulated briefly as follows. 

If the number n* of trials is increased without bound, the re- 
lative frequency of event A converges to the probability p of occur- 
rence of the event. 

Note. In the foregoing, we postulated relation (2) on the basis 
of experiments. But other natural conditions that follow from ex- 
periment have been postulated. From them relation (2) is derived, 
which then becomes a theorem. This is the familiar theorem of 
probability theory that bears the name of Jakob Bernoulli (1654— 
1705). 

Since probability is an objective characteristic of the possibility 
of occurrence of a certain event, to predict the course of numerous 
processes that one has to consider in military affairs, in the or- 
ganization of production, in economic situations, etc., it is neces- 
sary to be able to determine the probability of occurrence of cer- 
tain compound events. Determining the probability of occurrence 
of an event on the basis of the probabilities of the elementary 
events governing the given compound event, and the study of 
probabilistic regularities of various random events constitute the 
subject of the theory of probability. 
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8.2 THE CLASSICAL DEFINITION OF PROBABILITY 
AND THE CALCULATION OF PROBABILITIES 


In many cases it is possible to calctlate the probability of a 
random event by proceeding from an analysis of the trial. An 
example will help to illustrate this idea. 


Example 1. A homogeneous cube with faces labelled 1 to 6 is called a die. 
We will consider the random event of the occurrence of a number /(1</<6) 
on the upper face for each throw of the die. By virtue of the symmetry of the 
die, the events (the appearance of any number from 1 to 6) are equally probable. 
Hence they are called equally probable events. Given a large number of throws, 
n, it can be expected that the number / (and any other number from | to 6) 
will turn up in roughly n/6 cases. Experiments corroborate this fact. 

The relative frequency will be close to the number p*=1/6. It is therefore 
Sena that the probability of the number /(1</<6) turning up is equal 
o 1/6. 


Below, we will analyze random events whose probability can be 
calculated directly. i 

Definition 1. Random events in a given trial are called disjoint 
(mutually exclusive) if no two can occur at the same time. 

Definition 2. We will say that random events form a complete 
group if in each trial any one of them can occur but no disjoint 
event can occur. 

We consider a complete group of equally probable disjoint ran- 
dom events. We give the name cases to such events. 

An event (case) of such a group is termed favourable to the oc- 
currence of event A if the occurrence of the case implies the oc- 
currence of A. 


Example 2. We have 8 balls in an urn. Each ball is numbered from | to 8. 
Balls labelled 1, 2, 3 are red, the others are black. The occurrence of a ball 
labelled | (or 2 or 3) is an event favourable to the occurrence of a red ball. 


For this case, we can give a definition of probability that differs 
from that given in Sec. 8.1. 

Definition 3. The probability p of event A is the ratio of the 
number m of favourable cases to the number n of all possible cases 
forming a complete group of equally probable disjoint events, or, 
symbolically, 

P(A)=p=-, (1) 

Definition 4. If relative to some event there are n favourable 
cases forming a complete group of equally probable disjoint events, 
then such an event is called a certain event. A certain event has 
probability p=1. 

If not a single one of n cases forming a complete group of equa- 
lly probable disjoint events is favourable to an event, then it is 
termed an impossible event and has probability p=0. 
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Note 1. The converse assertions also hold true here. In other 
cases, however, for instance in the case of a continuous random vari- 
able (Sec. 8.12), the converse assertions may not hold true; in 
other words, from the fact that the probability of some event is 
equal to 1 or 0, it does not yet follow that this event is certain 
or impossible. 

From the definition of probability it follows that the relation 


O0<p<l 
holds true. 


Example 3. One card is drawn from a deck of 36 cards. What is the proba- 
bility of drawing a spade? 

Solution. This is a scheme of cases. Event A is the occurrence of a spade. 
We have a total of n=36 cases. The number of cases favouring A is m=9. 

9 1 

Consequently, P= 7° 

Example 4. Two coins are tossed at the same time. What is the probability 
of getting 2 heads? 

Solution. Let us compile a’scheme of all possible cases. 


First coin Second coin 
Ist case head head 
2nd case head tail 
3rd case tail head 
4th case tail tail 


There are 4 cases in all, of which one is favourable. Hence, the probability 
of obtaining two heads is 


ai) 
P=% 


Example 5. The probability of hitting a target from one gun is $ , from 


another gun, i . Find the probability of destroying the target in a simultaneous 


firing from both guns. The target will be destroyed if at least one of the guns 
makes a hit. 

Solution. This problem can be modelled as follows. Two urns contain 10 
balls each, numbered from 1 to 10, with 8 red and 2 black in the first urn, 
and 7 red and 3 black in the second. One ball is drawn from each urn. What 
is the probability that at least one of 2 drawn balls will be red? 

Since each ball of the first urn can be drawn with any ball of the second 
urn, there will be a total of 100 cases: n=100. 

Let us calculate the favourable cases. 

When each of the 8 red balls of the first urn is drawn together with any 
ball of the second urn, we will have at least one red ball, drawn. There will 
be 10x8=80 such cases. Drawing each of the two black balls of the first urn 
together with any one of the 7 red balls of the second urn gives us one red 
ball. There will be 2x7 14 such cases. This makes a total of m= 80 + 14 =94 
favourable cases. 
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The probability that there will be at least one red ball from among those 
drawn is 


_m_ 94 
P=, =T00 e 


Such also is the probability of destroying the target. 


Note 2. In this example, we reduced the problem of probabi- 
lity in gunfire to a problem of the probability of a given ball 
being drawn from an urn. Many problems in probability theory 
can be reduced to the “urn model”. This permits us to regard urn- 
model problems (drawing balls from urns) as generalized problems. 


Example 6. Ten items out of a set of 100 are defective. What is the proba- 
bility that 3 out of any 4 chosen items will not be defective? 
Solution. Four items out of 100 can be chosen in the following number of 


ways: n=C$o. The number of cases where 3 out of 4 items are nondefective 
is equal to m=C3,-Ch. 
The desired probability is 
oe a Cho: Cio _ 1424 


~0.3 
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8.3 THE ADDITION OF PROBABILITIES. 
COMPLEMENTARY RANDOM EVENTS 


Definition 1. The logical sum (union) of two events A, and A, 
is an event C consisting in the occurrence of at least one of the 
events. 

Below we consider the probability of the union of two disjoint 
events A, and A,. The union of these events is denoted by 


A, +A, 
A, or A,* 


The following theorem, which is called the theorem on the ad- 
dition of probabilities, holds true. 

Theorem 1. Suppose, in a given trial (phenomenon, experiment), 
a random event A, can occur with probability P(A,) and an event A, 
with probability P(A,). The events A, and A, are exclusive. Then 
the probability of the union of the events, that is, the probability 
that either event A, or event A, will take place, is computed from 
the formula 


or 


P(A, or A,) =P (A,) +P (A,) (1) 


* Note here that the “or” is inclusive and signifies the occurrence of at least 
one of the events, in accord with Definition 1. 
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Proof. Suppose 
P(A)=, P(A.) = 


Since the events A, and A, are exclusive, it follows that for a 
total number n of cases, the number of cases favouring the occur- 
rence of A, and A, together is equal to 0, and the number of ca- 
ses favouring the occurrence of A, or A, is equal to m, +m, 
Consequently, 


P(A, or A,)= “tm _™ 4M _ pA) +P(A,) 


and the proof is complete. 
The proof of this theorem is the same for any number of terms: 


P(A, or A, or ...or A,)=P(A,)+P(A,)+...+P(A,) (1°) 


This equation may be written thus: 
n 
p($ A :)= -Š P(A) (1”) 


Note. We proved the addition theorem for a scheme of cases 
where the probability is determined by direct computation. In the 
sequel we will assume that the addition 
theorem holds true also for the case where 
direct computation of probabilities is im- 
possible. This assertion is based on the 
following reasoning. For large numbers of 
trials, the probabilities of events are (with 
rare exceptions) close to the relative fre- 
quencies, and for the latter the proof is the 
same as that given above. This remark 
will hold true also in the proof of subse- 
quent theorems that we will prove by 
means of the urn scheme. 


Fig. 156 


Example 1. Shots are fired at a certain domain D consisting of three ar 
overlapping zones (Fig. 156). The probability of hitting Zone I is P(A)= 


Zone II, P(A) =a. and Zone IJI, P(A) =: What is the probability of 


hitting D? Event A is a hit scored in domain D. By formula (1') we have 
32 


P (A) +P (A) +P (A3) = twtio- 100 


Definition 2. Two events are called complementary events if they 
are exclusive and form a complete group. 
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If one event is denoted by A, the complement (complementary 
event) is denoted by A. 
Let the probability of the occurrence of event A be p, the pro- 


bability of the nonoccurrence_ of event A, that is, the probability 
of the occurrence of event A, be P(A)=q. 
On trial, either A or A will occur, therefore Theorem | gives 


P(A)+P(A)=1 


That is, the union of the probabilities of complementary events is 
equal to unity: , 
p+q=l (2) 


Example 2. A shot is fired at a target. Event A represents a hit. The proba- 
bility p of a hit _is P (A)=p. Determine the probability of a miss. A miss is 
given by event A, the complement of A. The probability of a miss is thus 
q=1—pP. 

Example 3. A measurement is made. Event A will denote an error less 
than À. Let P(A)=p. The complementary event is an error exceeding 4 or 
equal to À, and it is denoted by event A. The probability of this event is 
P (A)=q=1—p. 

Corollary 1. /f random events A,, A,, ..., A, form a complete 
group of exclusive events, then the following equation holds true: 


P(A)+P (4) +... +P(A) =1 (3) 


Proof. Since the events A,, A,, ..., A, form a complete group 
of events, the occurrence of one of them is a certain event. Conse- 


quently, 
P(A, or A, or ... or A,)= 


Transforming the left member by formula (1’), we get (3). 

Definition 3. Random events A and B are called compatible if 
in a given trial both events can occur, which is to say we have 
a logical product (intersection) of events A and B. 

The event which consists in the intersection of A and B is de- 
noted by (A and B) or (AB). The probability of the intersection 
of events A and B will be denoted by P(A and B). 

Theorem 2. The probability of the union of compatible events is 
computed from the formula 


P(A or B)=P(A)+P(B)—P(A and B) (4) 
The truth of formula (4) can be illustrated geometrically. We 


first give the following definition. 
Definition 4. Given a certain domain D with area S. Consider 


a subdomain d of D. Let S be the area of d. Then the probabi- 
lity of a point falling in d (the falling of a point in D is taken 
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to be a certain event) is, by definition, S/S, or p=S/S. This is 
called geometric probability. ~ T 
Then, assuming as certain the falling of a point in a square 
with unit side, we have (Fig. 157): 
P(A or B) =area abcda, 
P (A) = area abfda, (5) 
P (B) = area bcdeb, 
P(A and B) = area debfd 
We clearly have the equation 


area abcda = area abfda 
+area bcdeb— area debfd 


Putting into this equation the left mem- 
Fig. 157 bers of (5), we get (4). In similar fashion 
we can compute the probability of the 
union of any number of compatible random events. 
Note that Theorem 2 can be proved by proceeding from the fo- 
regoing definitions and rules of the operations. 


8.4 MULTIPLICATION OF PROBABILITIES 
OF INDEPENDENT EVENTS 


Definition 1. An event A is said to be independent of B if the 
probability of occurrence of A does not depend on whether event B 
took place or not. 

Theorem 1. Jf random events A and B are independent, then the 
probability of the intersection of events A and B is equal to the 
product of the probabilities of occurrence of A and B: 


P(A and B) =P (A)-P (B) (1) 


Proof. Let us carry out the proof by the urn scheme. Each of 
two urns has, respectively, n, and n, balls. There are m, red balls 
in the first urn, and the remaining balls are black. There are m, 
red balls in the second urn, all others being black. One ball is 
aes from each urn. What is the probability that both balls will 

e red? 

Let event A be a drawing of a red ball from the first urn. Event B 
will be a drawing of a red ball from the second urn. These events 
are independent. Clearly, 

m m 
P(A)=",  P(B) = (2) 

Altogether, there will be n,n, possible cases of simultaneous 

drawing of one ball from each urn. The number of cases favouring 
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red balls being drawn from both urns will be m,m,. The probabi- 
lity of the intersection of events A and B will be 
mm tm, , m 


P(A and B)= "itt. mi, T 


M Ma 


If in this formula we replace ni and by their expressions 
in (2), we get (1). The theorem is illustrated in Fig. 158. 
n, 
oem A 
o00000000 
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Fig. 158 


If we have n independent events A,, A,, ..., A,, then in simi- 
lar fashion we can prove the validity of the equation 


P(A, and A, and ... and A,)=P(A,)-P(A,)-...-P(A,) (3) 
Example 1. De tanks are firing at one and the same target. Tank me has 
a probability of 3 5 Í hitting the target, Tank Two, a probability of =. One 


shot is fired P each tank at the same time. Determine the probability that 
two hits will be scored. 


Solution. Here, P(A)= 
hits and is found from formula (1): 


P (B)=2 ; P(A and B) is the probability of two 


=". 5 3 

Example 2. No-failure operation of a device is determined by trouble-free 
operation of each of three component units. The probabilities of no-failure ope- 
ration of the units during a certain cycle are to p,-=0.6, pa=0.7, pa = 0.9. 
Find the probability that the device will not break down during the indicated 
operation cycle. 

Solution. By Theorem (3) on the multiplication of probabilities, we have 

P= Pı: P2: Pa = 0.6 X0.7 X0.9 = 0.378 


Note. Theorem 2, Sec. 8.3 [formula (4)], on the probability of 
the union of compatible events, with regard for formula (1) of this 
section, is then written as 


P(A or B)=P (A) +P (B)—P (A)-P (B) (4) 


Example 3. Solve the problem given in Example 5, Sec. 8.2, using for- 
mula (4). 
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Solution. Event A is a hit scored by the first gun. Event B is a hit scored 
by the second gun. It is obvious that 
8 a 
10 
8 7 9 


10°10 100 


We naturally obtained the same result as before. 

Example 4. The probability of destroying a target in one shot is equal to p. 
Determine the number n of shots needed to destroy the target with probability 
greater than or equal to Q. 

Solution. By the theorems on the union and intersection of probabilities we 


can write 
Q=1—(1—p)" 
Solving this inequality for n, we get 
logio (1 — Q) 
næ le 
log1o (1 — p) 


A problem with this kind of analytic solution can readily be stated in terms 
of the urn model. 


» 


~ 
= 
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8.5 DEPENDENT EVENTS. 
CONDITIONAL PROBABILITY. TOTAL PROBABILITY 


Definition 1. Event A is said to be dependent on event B if the 
probability of occurrence of A depends on whether B took place 
or not. 

The probability that event A occurred, provided that B took 
place, will be denoted by P(A/B) and will be called the conditio- 
nal probability of event A provided that B has occurred. 


Example 1. An urn contains 3 white balls and 2 black balls. One ball is 
drawn (first drawing) and then a second is drawn (second drawing). Event B is 
the occurrence of a white ball in the first drawing, event A, the occurrence of 
a white ball in the second drawing. 

It is clear that the probability of A, provided B has occurred, is 


P(A/B)= a => 


The probability of event A, provided B has not taken place (a black ball 
appears in the first drawing), will be 


P (A/B) -3 
We see that z 
P (A/B) # P (A/B) 


Theorem 1. The probability of the intersection of two events is 
equal to the product (logical intersection) of the probability of one by 
the conditional probability of the other computed on the condition 
that the first event has taken place, that is, 


P(A and B) =P (B)-P (A/B) (1) 


8.5 Dependent Events. Conditional Probability. Total Probability 455 
ei ee 


Proof. We carry out the proof for events that reduce to the urn 
model (that is, for the case where the classical definition of pro- 
bability is applicable). ° 

An urn contains n balls, of which n, are white and n, are 
black. Suppose the n, white balls include / balls marked with 
a star (Fig. 159). 


n 


a i 


l 
Fig. 159 


One ball is drawn from the urn. What is the probability of 
drawing a marked white ball? 
Let B be the event of a white ball being drawn, A the event 
of a marked white ball being drawn. It is then clear that 
P(B)=7 (2) 
The probability of a marked white ball being drawn, provided 
that a white ball has already been drawn, is 


P (A/B) == (3) 


The probability of a marked white ball being drawn is P 
(A and B). Obviously, 


P(A and B)=+ (4) 
But 
l n l 
a ee o 


Substituting into (5) the left-hand members of (2), (3) and (4), 


we get 
P(A and B)=P(B)-P(A/B) 


Equation (1) is proved. 

If the events under consideration do not fit the classical scheme, 
then formula (1) serves to define conditional probability. Namely, 
the conditional probability of A, provided event B has occurred, is 
determined by means of the formula 


P (A/B) aa [for P(B) 0] 


Note 1. Let us apply this formula to the expression P (B and A): 
P(B and A)=P(A)-P(B/A) (6) 
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In equations (1) and (6), the left-hand members are equal, since 
this is one and the same probability; hence, the right-hand members 
are also equal. We can therefore write the equation 


P(A and B) =P(B)-P(A/B) =P (A)-P (B/A) (7) 


Example 2. For the case of Example 1, given at the beginning of this sec- 
tion we have 


PiB)=*., P(A/B) => 


By formula (1) we get 
P(A and Hao ae 
~§ 2 10 


The probability P(A and B) can also be readily calculated directly. 

Example 3. The probability of manufacturing a nondefective (acceptable) 
item by a given machine is equal to 0.9. The probability of the occurrence of 
quality articles of grade one among the nondefective items is 0.8. Determine 
the probability of turning out grade-one articles by this machine. 

Soiution. Event B stands for manufacturing a nondefective article on the 
given machine. Event A stands for the occurrence of a grade-one item. 

Here, P(B)=0.9, P (A/B) =0.8. 

Substituting into formula (1), we get the desired probability: 


P(A and B)=0.9-0.8=0.72 


Theorem 2. If event A can be realized only when one of the 
events B,, B,, ..., B,, which form a complete group of exclusive 
events, occurs, the probability of event A is computed from the formula 


P (A) =P (B,)-P(A/B,) +P (B,) P(A/B,) +... +P(B,)P(A/B,) (8) 


Formula (8) is called the formula of total probability. 
Proof. Event A can occur if one of the compatible events 


(B, and A), (B, and A), ..., (B, and A) 


is realized. Consequently, by the theorem of addition of probabi- 
lities, we get 


P(A)=P(B, and A)+P (B, and A)+...+P(B, and A) 


Replacing the terms of the right side in accordance with for- 
mula (1), we get equation (8). 


Example 4. Three shots are fired at a target in succession. The probability 
of a hit in the first shot is p,=0.3, in the second, p==0.6, in the third, 
p3=0.8. In the case of one hit, the probability of destroying the target is 
A, = 0.4, in the case of two hits, A, =0.7, in the case of three hits, A= 1.0. 
Determine the probability of destroying the target in three shots (event A). 

Solution. Let us consider the complete group of exclusive events: 

B, means one hit, 

B, means two hits, 

B means three hits, 

B, means no hits. 
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We determine the probability of each event. One hit will occur if: either 
the first shot scores a hit and the second and third miss; or the first shot is 
a miss, the second is a hit, and the third is a miss; or the first shot is a miss, 
the second is a miss, and the third is a hite Therefore, by the theorem of 
multiplication and addition of probabilities, we get the following expression for 
the probability of one hit: 

P (By) = pı (1 — p2) (1 — Ps) + (1 — p1) Po (1 — p3) + (1 — p1) (1 — p2) Ps = 0.332 

Reasoning in like fashion, we have 
P (B2) = PyP2 (1 — Pg) +- P1 (1 — P2) Pa + (1 — P1) P2P3 = 0.468 
P (B3) = p Pops = 0.144 
P(B,) = (1 —p,) (1 — p2) (1 — p3) = 0.056 

Let us write down the conditional probabilities of destroying the target upon 
the realization of each of these events: 

P(A/B,)=0.4, P(A/B,)=+0.7, P(A/B3)=1.0, P(A/B,)=0 

Substituting the resulting expressions into formula (8), we get the probabi- 
lity of target destruction: 

P (A) =P (B,)-P (A;B,) -i-P (By) -P (A; B2) + P (B3) -P (A;B) 
-+ P (B,)-P (A/B,) = 0.332 -0.4 + 0.468 -0.7 
-+ 0.144- 1.0 + 0.056 -0 = 0.6044 


Note 2. If event A does not depend on event B, then 
P(A/B)=P (A) 
and formula (1) takes the form 
P(A and B)=P(B)-P(A) 
That is, we obtain formula (1), Sec. 8.4. 


8.6 PROBABILITY OF CAUSES. 
BAYES’S FORMULA 


Statement of the problem. As in Theorem 2, Sec. 8.5, we will 
consider a complete group of exclusive events B,, B,, ..., B,, the 
probabilities of occurrence of which are P(B,), P(B,), ..., P(B,). 
Event A can,occur only together with some one of the events 
B,, B}, ..., Ba, which we will call causes. 

The probability of the occurrence of event A is, in accord with 
formula (8) of Sec. 8.5, 


P (A) = P (B,) P (A/B,) + P(B,) P(A/B,) +... +P(B,)P(A/B,) (1) 


Suppose that event A has taken place. This fact will alter the 
probability of the causes, P(B,), ..., P(B,). It is required to 
determine the conditional probabilities of the realization of, these 
causes on the assumption that event A has occurred, that is, to 
determine 


P(B,/A), P(B,/A), .... P(B,/A) 
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Solution of the problem. By formula (7), Sec. 8.5, we will find 
the probability P(A and B,): 


P(A and B,) =P(B,)-P(A/B,) = P(A)-P(B,/A) 


whence 
__ P(B,)-P (A/B;) 
Substituting for P(A) its expression (1), we get 
P (B,/A) = = (B,)-P (A/B,) (2) 


Dd P (B;)-P (A/B; 
t=1 


The probabilities P(B,/A), P(B,/A), ..., P(B,/A) are determi- 
ned in similar fashion: 
P (B,)-P (A/B,) 


Raj (3) 
> P (BD-P (A/B;) 
i=l 


Formula (2) is called Bayes’s formula or the theorem of causes. 
(Bayes’s rule for the probability of causes.) 

Note. From formula (3) it follows that in the expression of the 
probability P (B/A) —the probability of the realization of cause B, 
provided that event A has occurred--the denominator is indepen- 
dent of the number k. 

Example 1. Suppose that prior to an experiment there were four equally 
probable causes: 

B,, By, Bs, By: P (By) =P (By) =P (By) =P (By) =0.25 
The conditional probabilities of the occurrence of event A are, respectively, 
equal to 
P(A/B,)=0.7, P(A/B})=0.1 
P(A/Bs)=0.1, | P(A/B,) =0.02 
Suppose the outcome of a trial yields event A. Then, by formula (3), we get 


P (BVA) = SET TURE OBT FOO o © 0-76 
P (B/A) = 2 0.11 

P (Ba =O =0.11 

P (By/A) = 2590-0? _0.02 


Here P(B,)=0.25, P(B,/A)=0.76 became greater because event A occurred. 
In this case, the probability P (A/B,)=0.7 is greater than the other conditional 
probabilities. 

Example 2. Each of two tanks fired independently at a target. The probabi- 
lity of the first tank destroying the target is p,=0.8, that of the second, 
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Po=0,4. The target is destroyed by a single hit. Determine the probability 
that it was destroyed by the first tank. 

Solution. Event A is the destruction of the target by a single hit. Prior to 
firing, we have the following possible causes: ° 

Bı, both tanks missed, 

Bz, both tanks scored a hit, 

Bs, the first tank scored a hit, the second missed, 

B,, the first tank missed, the second scored a hit. 

We find the probabilities of these causes by the theorem of multiplication 
of probabilities: 


P (By) = (1 —p,) (1 — po) = 0.2-0.6 = 0.12 
P (B2) = pipe = 0.8-0.4 = 0.32 

P (B4) = pı (1 — p2) = 0.8 -0.6 = 0.48 

P (B,) =(1 — pı) pa = 0.2-0.4 = 0.08 


We determine the conditional probabilities of occurrence of the event: 
P(A/B,)=0, P(A/B,)=0, P(A/B3)=1, P(A/B,)=1 
By formula (2) we find the conditional probability of the causes: 


P (B/A) = 5a GTO POET LOU = O56 
P (By A) = 932-9 0 
Pisum it 
P(By/A) = S081 _ 1 


Example 3. At a factory, 30% of the instruments are assembled by specia- 
lists of high qualification, 70% by those of medium qualification. The reliabi- 
lity of an istrument assembled by the former is 0.90, that assembled by the 
latter, 0.80. An instrument picked off the shelf turns out to be reliable. Deter- 
mine the probability that it was assembled by the specialist of higher qualifi- 
cation. 

Solution. Event A stands for reliable operation of the instrument. Prior to 
checking the instrument, we have the following possible causes: 

B,, the instrument is assembled by the highly qualified specialist, 

B,, the instrument is assembled by the specialist of medium qualification. 

We write down the probabilities of these causes: 


P(B,)=0.3, P(B,)=0.7 
The conditional probabilities of the event are 
P(A/B,)=0.9,  P(A/B.)=0.8 


We now determine the probabilities of the causes B, and By, provided that 
event A has occurred. 
By formula (2) we have 
0.3-0.9 0.27 
P (BVA) = 55-0.9-0.7-08 0.83 
0.7-0.8 __ 0.56 
0.3-0.9+0.7-0.8 0.83 


=0.325 


P (B,/A) = =0.675 
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8.7 A DISCRETE RANDOM VARIABLE. 
THE DISTRIBUTION LAW OF A DISCRETE RANDOM VARIABLE 


Definition. A variable quantity x which, in a trial, assumes one 
value out of a finite or infinite sequence x,, Xa, ..., X,, =. is 
called a discrete random quantity (or variable), if to each value x, 
there corresponds a definite probability p, that the variable x will 
assume the value x,. 

It follows from the definition that to every value x, there cor- 
responds a probability p,. 

The functional relationship between p, and x, is called the distri- 
bution law of probabilities of a discrete random variable x:* 


Possible values of the ran- 
dom variable 


The distribution law can also be represented graphically in the 
form of a polygon of probability distribution (also called a „frequency 
polygon): in a rectangular coordinate 
system, points are constructed with 
coordinates (x,, p,) and are joined 
by a polygonal line (Fig. 160). 

The distribution law can also be 
specified analytically: 


Pe = Í (%) 


The fact that a random variable x 
assumes one of the values of a sequence 
Xis Xa -++,) Xp -is a certain event, and so the condition 


X, Xz Z} L, 
Fig. 160 


aD 
È p:i=1 (1) 


must hold true for the case of a finite sequence of N values, or 


Ms 


pi=1 (1) 


1 


~, 
i 


for the case of an infinite sequence. The value x; of the random 
variable having the greatest probability is called the mode. The 
random variable x depicted in Fig. 160 has mode x,. 


* Or, briefly, the distribution law of a random variable. 
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Example 1. A variable x denotes fhe number that turns up in a single throw 
of a die. The variable x can assume one of the following values: 1, 2, 3, 4, 5, 6. 
The probability of any one value turning up is 1/6. We thus get the following 
table for the distribution of this random variable: , 


i | 


p 


3 


ejs] 


IE 


1/6 1/6 1/6 


u | u | 1/6 


Example 2. The probability of the occurrence of event A in each of an 
infinite sequence of trials is equal to p. The random variable x is the number 
of the trial in which A occurred for the first time. Find the law of distribution of. x. 

Solution. The random variable x can assume any integral positive value 
1, 2, 3, ... . The probability p, that event A will occur in the first trial is 

pPi=P(A)=p 
The probability p that the event will not occur in the first trial but will occur 
in the second is = 
pg=P(A and A)=(l—p)p 

The probability ps that A will not occur in the first or the second trial but 

will occur in the third is 


ps=P(A and A and A)=(!—p) (1—p) p=(1—p)? p 
and so on, 
Pe=(1—p)*-'p (2) 
Here is the table of distribution of probabilities: 
| i | 


| (1—p)k-" p 


p= Ù (1—p)t-! p=? — =1 
2 2 1—(1— p) 


Problem on firing to a first hit. The foregoing problem finds 
applications, in particular in the theory of gunfire. 

Suppose we have a case of gunfire to a first hit. The probability 
of a hit scored on each shot is p. 

The random variable x is the number of the shot in which the 
first hit was scored. The distribution table of the probabilities of 
this random variable will be the same as {n Example 2. 


Example 3. The probability of a hit on each shot is p=0.8. We have three 
shells. Determine the probability that one, two and three shells will be used if 
the gunfire is continued to a first hit or to a miss by all three shells; compile 
a table of the distribution of the random variable x (the number of shells used). 


2 | 3 


Pr p 


(1—p)p | (1—p) p | 


We also have 
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Solution. Let x be a random variable indicating the number of shells fired; 
P (x= x) is the probability that x, shells will be used. Then P(x=1)=p=0.8 
is the probability of a hit scored on the first shot. 


P (x = 2) =(1—p) p= (1 — 0.8) -0.8 = 0.16 
is the probability that the first shot was a miss, the second a hit. 
P (x=3)= (1 — p)? = (1 —0.8)-(1 —0.8) = 0.2-0.2 = 0.04 
because there are only three shells and gunfire ceases irrespective of whether 


the third shot is a hit or a miss. This last probability could also have been 
computed as a difference: 


1 —P (x= 1)—P (x = 2) = 1I —0.8— 0.16 = 0.04 
The distribution table will look like this: 


ANENE 


| o2 0.16 | 0.04 


P (x = Xp) 


Note. This problem can be stated in terms of the urn model, which means 
it can also be applied to other problems. This remark applies to certain 
other problems as well. 


8.8 RELATIVE FREQUENCY AND THE PROBABILITY 
OF RELATIVE FREQUENCY IN REPEATED TRIALS 


Suppose we have a sequence of n trials, in each of which event A 
canoccur with probability p. Let x be a random variable denoting the 
relative frequency of occurrence of event A in the sequence con- 
sisting of n trials. It is required to determine the law of distribu- 
tion of the random variable x in the n-trial sequence. 

It is quite obvious that in n trials x will assume one of the 
following values: 


0 1 2 n 
GH Be Tae 
Theorem 1. The probability P ( r=) that the random variable x 


will assume the value z, that is, that in n trials event A will 


occur m times and the event A (nonoccurrence of A) will occur n—m 
times is equal to C™p™q"-", where C™ is the number of combinations 
of n elements taken m at a time; p is the probability of the occur- 
rence of event A, p= P(A); q is the probability of the nonoccurrence 


of event A, that is, q=1—p=P (A). 
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Proof. Event A will occur m times in n trials, for instance, if 
the alternation of events A and A is as given below: 
AA... AAA... A 


— 
n-m 


which is to say, A occurs in the first m trials, and does not occur 
in the next n—m trials (event A occurs). Since 


P(A)=p, P(A)=1—p=q 


then by the multiplication theorem the probability of such an 
alternation of events A and A will be 


p™.qr-™ 


But event A can appear m times in n trials if we have a 
different sequence of events A and A. For example, given the alter- 
nation AA... AAA... A A. But it is necessary that A occur m 


Nee eee ~ 
m-l n-m 1 


times, and A, n—m times. The probability of the occurrence of 
this kind of alternation of events A and A is 


peg p = p”q"-” 
How many distinct alternations of events A and A can there be 
in n trials in which A occurs m times? It is clearly equal to the 
number of combinations of n elements taken m at a time: 


cm — "0> D(n—2) ... [2—(m—1)] 
we 1-2-3... m 


Thus, by the addition theorem, we have 
P ( pó z) O N RPNE keart pnnT 
n cm 
or 


p(x=2)= Crp™q"-™ (1) 


The proof of the theorem is complete. 

Having proved the theorem, we have thus determined the law 
of distribution of the random variable x; we give the law in the 
form of a table: 


p(x=5 


Cipagn-m 


)| lq" [es e=: C? p2qn-2 | nk 
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This distribution law is known as the binomial distribution be- 
cause the probabilities P x= are equal to the corresponding 
terms in the binomial expansion of the expression (q+ p)": 


(q+p)"= Dy Chp”q"-" (2) 


As was to be expected, the union (logical sum) of the probabi- 
lities of all possible values of the random variable is equal to 
l since (p+q)?=1"=1. 

Note. In the study of many problems it is often necessary to 
determine the probability that event A will occur “at least once”, that 


is, the relative frequency of the event, xBe. It is quite obvious 


that this probability P («> x) can be determined from the equation 
1 0 
P(x>7)=1—P(x=2)=1-9" (3) 


From the distribution table it also follows that the probability 
P x>+) that the event will occur no less than & times is found 
from the formula 


P(x>4)= $ crpg- (4) 
- > 
P(x>) =l — 2 Cronq” 


Example 1. Give a graphical representation of the binomial distribution of 
the random variable x for n=8, p=1/2, q=1/2. 
i eeann: We determine all the values of the probabilities that appear in the 
able: 
: 1\8 l 
ie —-4 0 8 — . — = = 
P (x=0) C3q8 = 1 a) 556 
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ee 7 
P(x=5 )= Chay 


— LC I1 
P(x=5)=& 339 e 
P = =C? ba l 

(«= )=c 25 256 


Let us construct the distribution polygon, or frequency polygon (Fig. 161). 

Example 2. What is the probability that event A will occur twice (a) in two 
trials, (b) in three trials, (c) in 10 trials, if the probability of the occurrence of 
the event in each trial is equal to 0.4? 


Fig. 161 


Solution. (a) Here, n=2, p=0.4, q=0.6: 
— 2 \ 62,290 —2:! 2 


(b) here, n=3, p=0.4, q=0.6: 


P (==5) = C§p*g! = ea (0.4)2-0.6 = 0.288 


(c) here, n= 10, p=0.4, g=0.6: 


_2 =C? 28 — 10-9 2. 8— 
P (2=75)= cio" = Ty (0.4)2-(0.6) = 0.121 


Example 3. Five independent shots are fired at a target. The probability of 
a hit in each shot is 0.2. Three hits suffice to destroy the target. Determine the 
probability of target destruction. 

Solution. Here, n=5, p=0.2, q=0.8. It is clear that the probability of 
target destruction should be computed from the formula 


pme (i)e telt] 


or from the formula 


tamiet) tl] 


30—2082 
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By the first formula we have 
5.4.3 
Paes = CÈ p’? + Chptg! + Cp => « (0-2) -(0.8) 
5.4.3.2 
+1334 
Example 4. Four independent trials are carried out. The probability of the 
occurrence of event A in each trial is 0.5. Determine the probability that A 


will occur at least twice. 
Solution. Here, n=4, p=0.5, q=0.5: 


(0.2)*-0.8-+ 1 -(0.2)8 = 0.05792 ~ 0.06 


We compute the probability 


p(x < F )=r(=4 +P (+= 4) == 054 00.5)¢= 0.3125 


Hence, by the second formula, we obtain 
P(x> +) = 1—[(0.5)4 +4 (0.5)4] = 0.6875 ~ 0.69 
Example 5. The probability of defective items in a given batch is p=0.1. 
What is the probability that in a batch of three items there will be m=0, 


1, 2, 3 defective items? 
Solution. 


3 
1 o 3 
P(1=7 = Cpg? = Ĉ-.0.1 -0.92 = 0.243 
_2 — C2p?2, _ 3:2 2 a 
P(x=7)=Chog =75 0 0.9 = 0.027 
3 3 
P( x=) =Cip?=1-0.19°=0.001 


8.9 THE MATHEMATICAL EXPECTATION 
OF A DISCRETE RANDOM VARIABLE 


Suppose we have a discrete random variable x with an appro- 
priate distribution law: 


Pı P2 


Definition 1. The mathematical expectdtion (or, simply, expecta- 
tion) of a random variable x (we symbolize expectation by M [x] 
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or m,) is the sum of the products of all possible values of the 
random variable by the probabilities of these values: 

M [x] =%,p,+%2Pet-.-+4nPn 
or, briefly, 7 


M [x] = > Pe (1 


Here, as has already been pointed out, 2 Pp=l. 


If the values of the random variable ibun an infinite sequence, 
then 


mM, = 2 XkPk (1’) 


We will consider only those random variables for which the 
series converges. 

We will now see what connection there is between the mathema- 
tical expectation of a random variable and the arithmetic mean of 
that variable for a large number of trials; namely, we will demon- 
strate that in a large number of trials, the arithmetic mean of the 
observed values is close to the expectation; or, in the terms of Sec. 8.1, 
we can say that the arithmetic ‘mean of the observed values of a 
random variable tends to the expectation when the number of trials 
increases without bound. 

Suppose that N independent experiments are performed and that 


the value x, occurred n, times, 
the value x, occurred n, times, 


e. e è è è ù è ò è è e è è ù 


the value xy occurred ną, times. 


The random variable x assumes the values x,, X}, ..., Xy 
We compute the arithmetic mean of the variables x (we denote 


it by M [x] or m,): 
te ae it IE xy Z +x, ae + xy (2) 
However, since in the case of a large number of trials N the rela- 
tive frequency ae tends to the probability of the occurrence of 
the value x,, it follows that 


v v 
2; x, 4k fe 2 XrPr 
k=1 k=1 
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Under rather natural assumptions we have 
M [x] —M [x] (3) 


Note 1. If we ccnsidered an urn scheme with N balls where there 
are n, balls labelled x,, n, balls labelled x, and so on, the expected 
value on drawing one ball will be expressed by formula (2), that 
is, it will be equal to m,. 

Example 1. Determine the expectation of the random variable x of the num- 


ber of hits in three shots if the probability of a hit in each shot is p=0.4. 
Solution. The random variable x can take on the values 


x,=0, xe=1, xg=2, x= 


We set up a distribution table of the given random variable. 
The probabilities of these values are found by the theorem on repeated trials 
(n=3, p=0.4, g=0.6): 


P (x = 0) = C$ (0.6)3 = 0.216 
P (x= 1) =C} (0.4) (0.6)? = 0.432 
P (x = 2) = C$ (0.4)2. (0.6) = 0.288 
P (x = 3) = C3 (0.4)3 = 0.064 

The distribution table of the random variable is 


x | 0 l | 2 E 


P (x= xp) 0.216 | 0.432 | 0.228 | 0.064 


We calculate the expectation from formula (1): 
m, =0-0.216-+ 1-0.432 + 2.0.288 + 3-0.064 = 1.2 hits 


Example 2. One shot is fired at a target. The probability of a hit is p. 
Determine the expectation of the random variable x of the number of hits. 
Form the distribution table of the random variable 


Consequently, m,=0-(1—p)+1-p=p. 

Note 2. In the sequel it will be established that the expectation 
M Íx] of the number of occurrences of event A in/n independent 
trials is equal to the product of the number of trials by the pro- 
bability p of occurrence of A in each trial: 


M [x] =np (4) 
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If in (4), 2 is the number of shots and p is the probability of 

a hit, then the solution of the problem of Example 1 will be: 
M [x] =np=3.-0.4 = L.2 hits 

If in formula (4) we know M [x] and p, then we can find n—the 
number of trials that yields the given expectation of the number 
of the occurrences of the event: 
Mix 
— p 

Example 3. The probability of scoring a hit in one shot is p=0.2. Deter- 
mine the shell consumption that will ensure expectation 5 of the number of hits: 

5 
n=jz3 75 shells 

(Note once again that similar problems occur in a variety of investigations. 
The word “hit” is replaced by “occurrence of an event” and “shot” is replaced 
by “trial”.) 
? Example 4. Determine the expectation of the random variable x with the 
following distribution table: 


TEREF k | 


x | 1 
Jae 


n 


Pr p (1—p)p (1 —p)? p 


See Example 2, Sec. 8.7 
Solution. From formula (1) we have (denoting 1 — p =q) 
ms=l1-p+2gp+34?p +... +kgt-tp+... 
=p (1+29g+39?+...--kg?-1+...) 


=p(at+g?t@+...+gt+...)'=p (4) 


Thus 
m=7 
Note that 
m —l as p—l 
Il,—oo as p—0 


These relations can be explained by the essence of the problem. 

Indeed, if the probability of occurrence of event A in each trial 
is close to 1(p~1), then it may be expected that A will occur 
in the first trial (m, œ% 1). But if the probability p is small (p ~ 0), 
then one can expect that in order for event A to occur it will be 
necessary to perform a large number of trials (m, = 00). 

The mathematical expectation of a random variable x is called 
the centre of probability distribution of the random variable x. 


470 Ch. 8 The Theory of Probability 


Note 3. The term “centre of probability distribution” is intro- 
duced by analogy with the term “centre of gravity”. If on the 
x-axis we place masses p,, Pa, ---, Pa at points with abscissas 
Xi Xa +++, Xm then from analytic geometry it is clear that the 
abscissa of the centre of gravity of these masses is determined from 
the formula 


>) XkPk 
Xc = frl 
D 
k=1 
n 
If > p,=1, then 
k=1 
n 
to= XnPp (5) 


Formula (5) coincides (in appearance) with formula (1) for mathe- 
matical expectation. 
` We have thus established that the centre of gravity of a series 
of masses and the expectation are computed from analogous for- 
mulas, whence the term “centre of probability distribution”. 


LZ, Lz Ty Ly Lg Lg Ly X L? LZ 1FOLEILF XE T? X° 
Fig. 162 Fig. 163 


Suppose we have a random variable x with ap associated distri- 
bution (Fig. 162); let its expectation be m,.\Now consider the 
difference between the random variable x and its expectation: x— my. 

We will call this quantity the centred random variable, or the 
deviation, and we will denote it by x°. 

It is quite clear that the distribution law /of this random vari- 
able x° will be 


(see Fig. 163). 
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Let us find the expectation of a centred random variable: 
n n n 
M [x—m,] = 2 (Xr — Ms) Pr = x XPr— È MxPr 
=m,—m, 3 Py=m,—m,-1=0 


Thus, the expectation of a centred random variable is equal to zero. 

Note 4. It is sometimes advisable to regard a nonrandom constant 
(a certain quantity) c as a random variable which assumes the 
value c with probability 1 and assumes all other values with pro- 
bability 0. 

Then it is meaningful to speak of the expectation of a constant: 


M [c] =c-l=c (6) 


The expectation of a constant is equal to that constant. 


8.10 VARIANCE. 
ROOT-MEAN-SQUARE (STANDARD) DEVIATION. MOMENTS 


In addition to the expectation of a random variable x, which 
defines the position of the centre of a probability distribution, a 
distribution is further characterized quantitatively by the variance 
of the random variable x. 

The variance is denoted by D [x] or o2. 

The word variance means dispersion. Variance is a numerical 
characteristic of the dispersion, or spread of values, of a random 
variable about its mathematical expectation. 

Definition. The variance of a random variable x is the expecta- 
tion of the square of the difference between x and its expectation 
(that is, the expectation of the square of the appropriate centred 
random variable): 


D [x] =M [(x—m,)"] (1) 
or 
D [x] AD (x,— my)? Pr (2) 


Variance has the dimensions of the square of the random vari- 
able. It is sometimes more convenient in describing dispersion tô 
make use of a quantity whose dimensions coincide with those of 
the random variable. This quantity is termed the root-mean-square 
deviation (standard deviation). 


o [x] =V DE 
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or, in expanded form, 
n 
o[x]= D (xa — Mx)? Pr (3) 
k=1 


The standard deviation is also denoted by o,. 
Note 1. In computing variance, it is often convenient to trans- 
form formula (1) as follows: 


n 


n n n 
D [x] = È (ama) Pe = D ipe —2 È XattesPet DL mpr 


n n n 
= 2 XRP,— 2M, 2 XePr +My p> Pr 


=M [x°] —2m,-m, + m2- 1 =M [x?] —m: 
Thus 
D [x] =M [x?] —m? (4) 


That is, the variance is equal to the difference between the expec- 
tation of the square of the random variable and the square of the 
expectation of the random variable. 


Example 1. One shot is fired at a target. The probability of a hit is p. 
Determine the expectation, the variance and the standard deviation. 
Solution. We construct a table of the values of the number of hits: 


qg=1—p. Hence, 
M [x]=1-p+0-q=p 
D (x) = (1 — p} p+ (0— p}? q4 =0°p £ pq = pq (5) 
o (x)= V pg 
Let us consider some more examples in order to get a good idea 


of what the concepts of variance and/ standard deviation mean as 
measures of dispersion of a random Nariable. 


Example 2. A random variable x-is specified by the following distribution 
law (see table and Fig. 164). 
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Determine the (1) expectation, (2) variance, (3) standard deviation. 
Solution. 

1. M(x] =2-0.343-0.4+4-0.3=3, 

2. D [x] =(2—3)?-0.3 + (3 —3)?-0.4-++ (4— 3)?-0.8 =0.6, 


3. o [x] = VD [x] = V0.6=0.77. 


0 2 3 4T 
Fig. 164 


Example 3. A random variable x has the distribution law (see table and 
Fig. 165): 


Determine the (1) expectation, (2) variance, (3) standard deviation. 

Solution. 

1. M[x]=1-0.3+3-0.4+5-0.3=3, 

2. D [x] = (1 —3)?-0.3-+ (3— 3)2-0.4 + (5 —3)?-0.3 =2.4, 

3. o[x]= V 2.4=1.55. 

The dispersion of the random variable in the first example is less than that 
in the second example (see Figs. 164, 165). The variances of these quantities 
are equal to 0.6 and 2.4, respectively. 

Example 4. A random variable x has the following distribution law (see 
table and Fig. 166): 


Fig. 166 


Determine the (1) expectation, (2) variance, (3) standard deviation. 
Solution. 

1. M[x]=3-1=3, 

2. D[x]=(3—3)?-1=0, 

3. o [x] =0. 

There is no dispersion of the kandom variable in thig/ease. 
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Note 2. If we regard a constant as a random variable which 
assumes a value c with probability 1, then it is easy to demon- 
strate that D [c] =0. 

Proof. It has been shown [see (6), Sec. 8.9] that M [c] =c. From 
formula (1) we get 


D [c] =M [(c—¢)}] =M [0] =0 


which completes the proof. 

Note 3. By analogy with the terminology of mechanics, we can 
call the expectations of the quantities (x—m,), (x—m,)? the first 
central moment and the second central moment of the variable x. 
A third central moment is also considered: 


n 
PA (Xk — Myx)? Pr 


If a random variable is distributed symmetrically about the centre 
of the probability distribution (Fig. 162), it is then obvious that 
its third central moment will be equal to zero. If the third moment 
is different from zero, the random variable cannot be distributed 
symmetrically. 


8.11 FUNCTIONS OF RANDOM VARIABLES 


Let a random variable x be given by the following distribution 
law: ` 


We consider unction of the random variable x: 
y=f(x). 
The values of the function y,==/(x,) will be the values of the 
random variable y. 
If all the values y,~=/(x,) are distinct, then the distribution 
law of the random variable y is given by the table 


y=f(x) y=f(x) | Yy2=f (x) Yr =F (xp) 


Pk | Pı | P2 | tee 
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If some of the values y,=f(x,) are equal, the appropriate co- 
lumns may be combined into one by combining the corresponding 
probabilities. 

The expectation of the function y =f (x) “of the random variable x 
will be found from a formula similar to formula (1) of Sec. 8.9: 


MIHO] = È, fe) pa (1) 


In similar fashion we determine the variance of the function: 


DEF = MIE MIF Coe] = È a) mr o) p 


Example. A random variable ọ is given by the ie distribution law: 


We consider a function of this random variable: 
y=Asing 
We form the distribution table for the random variable y: 


Let us find the expectation of the function: 


M[A E EE aye Ave 
A A (0.2+ 0.14) =0.34A 


0.140-0.244 


0.34-A-0.3 


Problems of this kind occur in the consideration of oscillatory processes. 


8.12 CONTINUOUS RANDOM VARIABLE. 
PROBABILITY DENSITY FUNCTION OF A CONTINUOUS RANDOM 
VARIABLE. THE PROBABILITY OF THE RANDOM VARIABLE 
FALLING IN A SPECIFIED INTERVAL. 


An example will help to cast some light on the problem at hand. 
Example. The amount of wear of a cylinder is measured after a certain 
period of operation. This quantity is determined by the |value of the increase 


in diameter of the cylinder. We denote it by x. From the ¢ssence of the problem, 


it jollows that x can assume any a in a certain interval (a, 6) of possible 
values. 
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This quantity is termed a continuous random variable. 

We consider the continuous random variable x specified on a 
certain interval (a, b) which can also be an infinite interval, 
(—oo, +00). We divide this interval into subintervals of length 
Ax;.,;=%;—*;-, by the arbitrary points x,, Xis Xas --+5 Xp 
= Suppose we know the probability that the random variable x 
will fall in the interval (x,;_,, x;). We denote this probability by 
P (x;-, <x <x;) and represent it as the area of a rectangle with 
base Ax, (Fig. 167). 


Xo T, Ti-Ti Xn-1%_ T 


Fig. 167 


For each interval (x;_,, x;) we determine the probability of x 
falling in this interval and, hence, we can construct an appropriate 
rectangle. The result is a step-like broken line. 

Definition 1. If there exists a function y= f (x) such that 


lim P(x < x < x-+Ax) =f 
Ax >00 Ax 


(1) 


e probability density function 

unction) of the random variable x, or the 

distribution. (It is also called the fre- 

y quency function, distribution density, or 

the probability density.) We will use x 

to denote the continuous random varia- 

0 L L+AL x ble, x or x, to denote the values of this 

Fig. 168 random variable. If it is clear from the 

context, we will occasionally drop the 

baron x. The curve y =f (x) is called the probability curve or the dis- 

tribution curve (Fig. 168). Using the definition of limit, from 

equation (1) follows, to within infinitesimals of higher order than 
Ax, the approximate equation 


then this function f(x) is te 
(or, simply, density 


P(x <x <x+Ax) & f (x) Ax (2) 
We will now prove the following theorem. 
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Theorem 1. Let f(x) be the density function of the random vari- 
able x. Then the probability that a value of the random variable x 
will fall in some interval (a, B) is equal to the definite integral 
of the function f(x) from a to B; that ts, we have the following 
equation: 


B 
P(a<¥<B)={ f(x)dx (3) 


a 


Anz, Tz Tn P =L, 


'n 
Fig. 169 


of 


Proof. Partition the interval (a, $) into n subintervals by the 
points a= x,, x,, ..., Xa4,= 6 (Fig. 169). Apply formula (2) to 
each subinterval: 

P(x, < X< x) © f (x,) Ax, 
P(x, < X< xa) =f (x) Ax 


P (£n < X < Xai) © Ô (Xp) AX, 


Adding the left and right members of the equations, we will clearly 
get P (a <x < p) on the left. We thus have the approximate equation 


n 
P(a<cx< B) ~ È f(x) Ax; 
Passing to the limit in the right member as max Ax;—-0, we get, 


on the basis of the properties of integral sums, the exact equation 


Pa<¥<f)= lim Di (x) Ax 


max Ax; > = 


(We assume that f(x) is such that the limit on the right exists.) 
The limit on the right is the definite integral of the function f (x) 


from a to B. Thus 
= B 
Ga 


a 
which completes the proof. 
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Thus, knowing the probability density function of a random 
variable, we can determine the probability that a value of the 
random variable will lie in a given interval. Geometrically, this 
probability is equal to the area of the resulting curvilinear tra- 
pezoid (Fig. 170). 

Note. In the case of a continuous 
random variable, the probability of 
an event that x= x, will be equal to 
ze 


ro. 
Indeed, putting x=x, in equation 
(2), we get 


P (x, <x < xX, + Ax) & F (x,) Ax 


Fig. 170 


whence 
lim P(x, <x <x,+Ax)=0 
Ax > 


or 7 
P(x =x,)=0 


(Also see Note | on page 448.) For this reason, in (3) and the 
preceding equations we can write not only P (œ <x < p) but also 
P(axx<f), sinc 


P(a<x<f)=P(x=a)+P(a<x<f)+P(x=fp)=P(a <x <6) 


If all possible vdlues of the random variable x lie in the inter- 
val (a, b), then 
b 


f F)dx=1 (4) 


since we are certain that a value of the random variable will lie 
in the interval (a, b). 
If the interval of possible values is (— œo, +œ), then 

f f (x)dx=1 (5) 
Note that if it follows from the essence of the problem that the func- 
tion f (x) is defined on the finite interval (a, b), then we can regard 
the function to be defined on the whole infinite interval (— oo, 
+ œœ), but 

f(x) =0 


outside the interval (a, b). In this case, both (4) and (5) hold 
true. The density function of the random variable fully determines 
the random variable. 
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8.13 THE DISTRIBUTION FUNCTION. 
LAW OF UNIFORM DISTRIBUTION 


Definition 1. Let f(x) be the density function of some random 
variable x(— 00 <x <+ 00); then the function 
F(xy= (fdr (1) 
is called the distribution function. 
For a discrete random variable, the distribution function is 
equal to the sum of the probabilities of those values x, which are 


less than x: 
Fid= È p 
Xp <x 


From equation (3), Sec. 8.12, it follows that the distribution 
function F (x) is the probability that the random variable x will 
assume a value less than x (Fig. 172): 


F (x) =P (— œ < x< x) (2) 


It follows from Fig. 171 that for a given value of x, the value 
of the distribution function is numerically equal to the area bounded 
by the distribution curve lying to the left of the ordinate drawn 
through the point x. 


Fig. 172 


The graph of the function F (x) is termed the probability distri- 
bution curve (Fig. 172). 

Passing to the limit as x— +0 in (1), with regard for (5), 
Sec. 8.12, we get 


lim F(x)= lim f Fi) de— { F@)ax=1 


Now let us prove the following theorem. 


Theorem 1. The probability of a random variable x lying in a 
given interval (a, B) is equal to the increment in the distribution 
function over that interval: 


P (a < Z< B) = F (B)—F (d) 
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Proof. Let us express the probability of x to assume a value 
lying in the given interval (a, B) We rewrite formula (3), 
Sec. 8.12, as 


B B a 
P(a<x<p)y=\ f(xjde= | f(xydx— | fads 
(see Fig. 173). Or, using (1), we can write 


P (a < x < p) =F (p)—F (a) 
which \completes the proof (see Fig. 174). 


Note that the density function f(x) and the corresponding dis- 
tribution function F(x) are connected by the relation 


F’ (x) =f (x) (3) 
This follows from (1) and the theorem on differentiating a definite 
integral with respect to the upper limit. 

We now consider a random variable with a uniform distribution 
of probabilities. The distribution law, or the density function, 
f(x) of such a random variable is de- 
fined as follows: 

f(x)=0 for x<a 
F(x)=c fora<cx<b 
f(x)=0 forb<x 
On the interval (a, 6) the density func- 
Fig. 175 tion f(x) has a constant value c (Fig. 
175); outside this interval it is zero. 
Such a distribution is also called the law of uniform distribution. 


a a pB bz 


From the condition f f (x)dx=1 we find the value of c: 
w i b 


f f (x) dx =| cdx=c(b—a)=1 
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hence 


From the last equation it follows that the interval (a, b) of uni- 
form distribution is necessarily finite. Let us determine the pro- 
bability that the random variable x will assume a value lying in 
the interval (a, ß): 


B B 
P(a<¥<Pp)=(f(xjde=| 1. dra Boe 


Thus, the desired probability is 
P(a<x<p)=fo% 


(this relation is similar to the definition of geometrical probability 
for the two-dimensional case given on page 452). 
We now determine the distribution function 


F(= | f(xdx 


If x<a, then f(x)=0, and, hence, 
F (x) =0 
If a<x<b, then i) =~ and, hence, 


x l as 
F() =| payee 5G 
a 
If b <x, then: 


Fo) =0, ffæde=0 


hence F(z) 
à i ba i 
F(= f Fo dr= | hd 
-0 a % 0 a b zx 
(see Fig. 176). Fig. 176 


The following are examples of random 
variables that obey the law of uniform. distribution. 


Example 1. The measurements of a certain quantity are rounded to the 
nearest scale division. The rounding errors are a random variable with uniform 
distribution of probabilities. If 2/ is the number of certain units in one scale 
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division, then the density function of this random variable is 
0 for x<—l 


l 
f(x) =. a for —lL<x<l 
| 0 for l<x 


Here, a=—I/, b=l, c=. 
Example 2. A symmetric wheel in rotation comes to a stop due to friction. 
When the wheel comes to rest, the angle @ formed by a certain definite moving 


radius of the wheel with a fixed radius is a random variable with a density 
function 
0 fr @<0 
l 
f (0) = 7x for O0<0<2n 
0 for 2n<6 


8.14 NUMERICAL CHARACTERISTICS 
OF A CONTINUOUS RANDOM VARIABLE 


In the same manner that we considered a discrete (discontinuous) 
random variable, let us now examine the numerical characteristics 
of a continuous random variable x with density function f (x). 

Definition 1. The mathematical expectation of a continuous ran- 
dom. variable x with density function f(x) is the expression 


M [x] = | xf (x) dx (1) 
If a random variable x can assume values only on a finite inter- 
val [a, b], then the expectation M [x] is expressed by the formula 
b 
M [x] = { xf (x) dx (1’) 
a 


Formula (1’) may be regarded as a generalization of formula (1), 
Sec. 8.9. 

Indeed, partition [a, b] into subintervals (x,_,, x), in each of 
which we take a point §. Consider the auxiliary discrete random 
variable & which can take on the values 


Èi; Eas ones En sey A 


Let the probabilities of thé corresponding values of the discrete 
random variable be p,, Pa, ..-, Pres +++» Pri 
Pi=F G) Axı, Pa = f (E,) Axe, «+55 
Pr =F (Ex) AXp, sree Pn = f (En) Ax, * 


* At the same time, f (E,) Ax, is the probability that the continuous random 
variable x will assume a value in the interval (xg-,, xx). 
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The expectation of the given discrete variable & will be 


M [$] S2 EePRe 
or 
M [$] =&,f (E1) Ax, + Sof (E2) Axa +... + Erf (Ee) Ax, + 


+ Enf En) Ara = D Ea E Ay 


Passing to the limit as max Ax, — 0, we get 


n b 
im D bal Ex) Ag = (xf (2) dx 


max Ax, > Ok= ` 


The expression on the right is the expectation of the continuous 
random variable x which can take on any value of x in the inter- 
val [a, b]. The reasoning is similar for an infinite interval, that 


y y 
fiz) 
Fig. 177 Fig. 178 


is, for the expression (1). Formulas (1) and (1’) are similar to for- 
mula (1) of Sec. 8.9 for a discrete random variable. We use the 
symbol m, for the expectation. 

The expectation is called the centre of probability distribution 
of the random variable x (Fig. 177). If the distribution curve is 
symmetric about the y-axis, that is, if f(x) is an even function, 
then clearly 

M[x] = § xf(x)dx=0 
In this case the centre of the distribution will coincide with the 
coordinate origin (Fig. 178). Let us consider a centred random 


variable x—m,. We will find its expectation: 


M[x—m,] = | œm) f(x)dx= | xf(x)de—m, | F dx 


== My — My: l =0 


The expectation of a centred random variable is zero. 


31 * 
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Definition 2. The variance of a random variable x is the expec- 
tation of the square of the corresponding centred random variable: 


D[x] = | @—m,)* f(x)dx (2) 


Formula (2) is similar to formula (2) of Sec. 8.10. 


Definition 3. The standard deviation of a random variable x is 
the square root of the variance: 


oz] =V D [7] = y | e= m0) dx (3) 


This formula is similar to formula (3) of Sec. 8.10. When we 
consider some illustrative examples, we will see that as in the 
case of a discrete random variable, 

Y the variance arid the standard de- 
viation are measures of the disper- 

sion of values of the random va- 


riable. 
Definition 4. The value of the 
0O M T random variable x for which the 
Fig. 179 density function is a maximum 


is termed the mode (symbolized 
by M,). For the random variable x, the distribution curve of 
which is shown in Figs. 177 and 178, the mode coincides with 
the expectation. 
Definition 5. A number (symbolized by M,) is called the median 
if it satisfies the equation 


M, m 
ra= f fede > (4) 


e 


(Fig. 179). This equation may be rewritten as 
P(E <M) =P(M, <%)=5 


This means that there is an equal probability that the random 
variable x will assume a value less than M, and greater than M,. 

a that the random variable x may not take on the value M, 
at all. 
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8.15 NORMAL DISTRIBUTION. 
THE EXPECTATION OF A NORMAL DISTRIBUTION 


Studies of various phenomena show that many random variables, 
such, for example, as measurement errors, the lateral deviation 
and range deviation of the point of impact from a certain centre 
in gunfire, and the amount of wear in machine parts, have a den- 
sity eae given by the formula 


ra=- exp [—SS*] O 


We say the random variable has 
normal distribution or is normally 
distributed (the term Gaussian dis- Fig. 180 
tribution is also used). The so-called 
normal curve (normal distribution curve) in shown Fig. 180. A table 
of the values of the function (1) for a=0, o=1 is given in the 
Appendix, Table 2. A similar curve was investigated in detail 
in Sec. 5.9 of Vol. I. 

First of all, we will show that the density function (1) satisfies 
the basic relation (5) of Sec. 8.12: 


f f(x)dx=1 


Indeed, introducing the notation 


x—a A 5 
yah dx =-o0V 2dt 


we can write 


co e—a 4 EET gee 
\sywee [at ]e=ys fe Va 
since (see Sec. 2.5, Example 2) 
J: e-"dt=V n 


We will determine the expectation of a random variable with 
normal distribution [see (1)]. By formula (1) of Sec. 8.14 we have 


igs: f x aren [Ee] (2) 


a / 


Making the change of variable 


Sle 
xi] 
wl a 
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we get 
x=a +V 20t, dx=oV 2at 
Hence 
m= | (a+V 2ot) e-" dt 
1 ¢ a ie 
= -t? -1? 
zaje dt fiera 


-0 


The first integral on the right is equal to VE Let us compute 
the second integral: 


ai 


í t-e- dt = =z? =0 


Thus 
m,=a (3) 


The value of the parameter a in formula (l) is equal to the 
expectation of the random variable under consideration. The point 
x=a is the centre of the distribution or the centre of dispersion. 
When x=a the function f(x) has a maximum and so the value 
x=a is the mode of the random variable. Since the curve of (1) 
is symmetric about the straight line xa, then 


a ao 

| F) ax= $ f(x)dx 

That is, the value x=a is the median of the normal distribution. 
If in formula (1) we put a=0, then we 


y get 


Fo= yg e(r) A 


OV2IT The corresponding curve is symmetric 
about the y-axis. The function f (x) is the 
0 z density function of normal distribution 
Fig. 181 of a random variable with centre of pro- 

E- bability distribution coincident with the 

origin (Fig. 181). The numerical characteristics of random va- 
riables with distribution laws (1) and (4) defining the type of 
dispersion of values of the random variable about the centre of 
dispersion are determined by the shape of the curve, which is 
independent of a, and therefore coincide. The quantity a deter- 
mines the amount of shift of the curve (1) to the right (for a>0) 
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or to the left (for a< 0). To save space, in most of our discussions 
we will henceforth use the probability density function defined by 
formula (4). 


8.16 VARIANCE AND STANDARD DEVIATION 
OF A NORMALLY DISTRIBUTED RANDOM VARIABLE 


Suppose the probability density function (the frequency function) 
of the random variable x is vali by 
2 
f(x)= SE exp (—sr) (1) 


The variance of a continuous random variable is found from 
formula (2), Sec. 8.14. 
In our case 


We have 


e . . x 
Making the substitution va =t, we get 


D [x] = 


ve ( te" dt = 7 ( 1-2t-e-" dt 


Integrating by parts, we obtain 


D [x] =e [-re" K í rat] 


wo 


lim t-e-“ =0, f e-d =V x 


t => o 


Since 


-0 


we finally have 


D [x] =0° (2) 
The standard deviation, in accordance with formula (3), Sec. 8.14, is 
o [x] =V D [x] =e j 


Thus, the variance is equal to the parameter o? in the density- 
function formula (1). We have already pointed out that the variance 
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characterizes the dispersion of values of the random variable about 
the centre of dispersion. Let us now see how the value of the 
parameter o° affects the shape of the distribution curve (frequency 
curve). Fig. 182 gives the dis- 
tribution curves for the va- 
lueso= +, o=1, o=2. We 
see here that the smaller 
o, the greater the maximum 
of the function f (x), also the 
greater the probability of va- 
lues close to the centre of dis- 
persion (x= 0) and the small- 
Fig. 182 er the probability of values 
distant from the origin. We 
can thus say that the smaller the variance o?, the smaller the 
dispersion of values of the random variable. 


8.17 THE PROBABILITY OF A VALUE OF THE RANDOM 
VARIABLE FALLING IN A GIVEN INTERVAL. 
THE LAPLACE FUNCTION. 
NORMAL DISTRIBUTION FUNCTION 
In accordance with formula (3), Sec. 8.12, we determine the 


probability that a value of the random variable x having the 
density function 
l ez] 


F) => ra (= 


will fall in the interval (a, f) 


B 
P(a<x<p)=|f(xax 
or i 
- 1 R (x — a)? 
P(e <¥<P)= re | exp [—S50"] ae (1) 
a 
(Fig. 183). Making the change of variable 
x—a t 
oy? 
we get B-a 
‘i 
_- 1 , 
P (a < x <B) = —= e-" dt a) 
Va 


8.17 The Laplace Function. Normal Distribution Function 489 


The integral on the right is not expressible in terms of elementary 
functions. The values of this integral can be expressed in terms 
of the values of the probability integral , 


D (x)= "74 f e-"dt (2) 
0 


Here are some of the properties of the function ® (è) which we 
will use later on. 
1. ® (x) is defined for all values of x. 


2. ®(0)=0. 
ai apg 8 Wars 
3. D(+00) = va | d=- y TL. 
4. M(x) is monotonic increasing on the interval (0, o9). 
5. ®(x) is an odd function since 


D(— x)= — 0 (x) (3) 


6. The graph of the function ®(x) is shown in Fig. 184. 
Detailed tables of the values of this function have been compiled 
(a short table is given in the Appendix, Table 1). 


7 (x) 
y 1 
Y 0 


Rewrite equation (1’) using the theorem on the partition of the 
interval of integration: 
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This equation can be rewritten as follows: 


o 


o 2 o 


B-a a-a 
= TEPERT ; Vz 
Pla <x< B= Va f e`! Gia f e~! dt 
0 0 


With the aid of the function ® (x) [see (2)], we give a final 
expression for the probability of the normally distributed random 


variable x falling in the interval (a, 8): 


Pia<i<f)=7/0(22)_0(2 4) (4) 
When a=0 we have 
recica toh- O 


Equating the right members of (1) for the case a=0 and of (5), 
we get 


1 


B be bud 7 
farrea] © 


We frequently have to compute the probability that a value of the 
random variable will fall in the interval (a—l, a+ l) symmetric 


about the point x=a (Fig. 185). Formula (4) then takes the form 


retci<a+n=3[0(=¥3)-9(-sya)] 
Noting that ® (—s75)=-0( : 7) [see formula (3)], we 
finally get í g 


P(a—l<x<at)=0(—) (6) 
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The right side does not depend on the position of the centre of 
dispersion, and so for a=0 as well we get 


P(—1<x<)=0(- Vi) (7) 


Example 1. A random variable x obeys the normal distribution law with centre 
of dispersion a=0.5 and variance gas. Determine the probability that a 


value of the random variable x will fall in the interval (0.4, 0.6) (Fig. 186). 


04 Me Ani 
Fig. 186 


Solution. Here 


1 
—=2. By formula (4) we have 
3v2 y ) 


P (0.4 < x < 0.6) => {® [2 (0.6—0.5)] -- ® [2 (0.4—0.5)]} 
1 
=7 {® (0.2)—® (—0.2)} 
But ®(—0.2)= — O (0.2) [see formula (3)] and so we can write 
P(0.4<x< 0.6) =4[@ (0.2) + ® (0.2) = ® (0.2) 
Using the table of values of the function ® (x) in the Appendix, we find 


P (0.4 < x < 0.6) =0.223 


Example 2. The length of an item manufactured on an automatic machine 
tool is a normally distributed random variable with parameters M [x] = 10, 


ee. Find the probability of defective production if the tolerance is 
300 ° p 


Solution. Here, a= 10, =10, o= . The probability of defective 


1 l 
oV2 10y 2 
production, Peş is, in accordance with (4), 
Paes=1—P (9.95 < x < 10.05) 


=1 -540 [10 (10.05 — 10)] —® [10 (9.95 — 10)}} 


=1-7 {© (0.5) —@ (—0.5)}= I — 0 (0.5) = 1—0.52 =0.48 


499 Ch. 8 The Theory of Probability 


Example 3. Find the probability of hitting a strip of width 2/-=3.5 metres 
if the errors of gunfire obey the normal distribution law with parameters a=0, 
o=1.9. 


Solution. Here, «= — 1.75, B=1.75, = 0.372. From formula (7) we get 


l 
oy 2 
P(—1.75 < x < 1.75)=@ (1.75-0.372) = ® (0.651) = 0.643 
Note. In place of the function ®(x), (2), frequent use is made 
of the Laplace function 
x thd 
D= |e * at (8) 


2n e 
ó 


The Laplace function is connected with the function @(x) by 
t 


a simple relation. In (8) make the change of variable ar as to 
get 
x 
1 ve 1 
D= f edz = 7 O( 3) 
Thus 
re l x 
Pa =5 O (F) (9) 
and, obviously, 
D(xV 2) =4 (x) (10) 
Using the function ®(x) and relation (9), we write (5) as follows: 
P(a<x<p)-0(£)—6(=) (11) 


and when o= |1 
P (a < x< B)=0 (f)—® (a) 


A table of the values of the Laplace function ® (x) is given in 
the Appendix, Table 3. 

Now let us define the normal distribution function. From formula 
(1), Sec. 8.13, we have 


x 


F (x) = f F(x) dx =— 7 f exp e] dx =P (—œ< x <x) 


Qn 


oO 


Using formula (4) for the case œ == —oo, B =x, we get 


rent o(p) -ece 
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but ®(—oo)=—1 [see formula (3)]. 
Hence, ‘ 


F(x% = 7|°(35 z) +1] (12). 


The graph of the Cha F(x) for 
a==0 is shown in Fig. 187. Fig. 187 


8.18 PROBABLE ERROR 


The probable error (or mean error) is a measure of dispersion 
that has found numerous applications in the probability, gunfire 
and errors theories. 


f(x) 
f(z) 
-£ 0 E x 0 a-E a aE x 
Fig. 188 Fig. 189 


Definition 1. The probable error is a number E such that the 
probability that a random variable obeying the normal distribu- 


tion law 
=! ok. 
ia o V2n Exp ( 20? ) 


will fall in the interval (—E, E) is + (Fig. 188); that is, 


P(—E<x<E)=4 ` (1) 
For any random variable x subject to the normal distribution 


law with centre of dispersion at x=a, the probable error E 
(Fig. 189) satisfies the relation 


P(a—E<x<a+E)=5 (2) 


Let us express the standard deviation o in terms of the pro- 
bable error E. 
We express the left member of (1) in terms of the function D(x): 


P(—E<x<£)= f sym? (ae) d (3) 
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From formula (7), Sec. 8.17, we get 


ee E 
—E <E) -D = 
P(—E<x<£)--®(—) (4) 
The left members of (1) and (4) are equal, and so also are the 
right members: 
E 1 
G ( oV2 ) 2 2 


Using the table of values of the function ® (x), we find the 
value of the argument x-==0.4769 for which O(xy=t. Hence 
E 

ei = 0.4769 


The number 0.4769 is ordinarily denoted by p: 
— =p -=0.4769 (6) 


whence 


(7) 


8.19 EXPRESSING THE NORMAL DISTRIBUTION 
IN TERMS OF THE PROBABLE ERROR. 
THE REDUCED LAPLACE FUNCTION 


Expressing the parameter o in terms of the parameter E by 
formula (7), Sec. 8.18, and substituting into (4), Sec. 8.15, we 
get an expression of the distribution in terms of the probable error: 


Fa = y= (e) (1) 


The probability of the random variable (an error, for example) 
falling in the interval (æ, B) will, in accordance with (5), Sec. 
8.17, be 


P(a<x<p)= 5 [0(p £)—o(p $)| (2) 

and, in accordance with formula (7) of Sec. 8.17, 
P(—I<x¥<I) =® (p4) (3) 
The numbers and $ in the right member of (2) are determined 


by the nature of the problem; p = 0.4769. 


8.19 The Reduced Laplace Function 495 


In order to avoid multiplying by pọ in each computation, tables 
have been compiled for the function ® (px). This function is de- 


noted by Ê (x): p 
f Ô (x) = ® (px) (4) 


and is called the reduced Laplace function. See Table 1 in the 
Appendix for values of this function. 


On the basis of (2), Sec. 8.17, the function Ê (x) is defined by 
the integral 


Making the change of variable ¢==pz, we get 


x 


Ô (x) = ne f e-02"dz (5) 
0 


Let us express the right member of (2) in terms of the reduced 
Laplace function: 
l 


Pa<z<p=4|êô®($)-6(4) (6) 


In particular, the probability of a value of a random variable 
falling in a symmetric interval about the centre of dispersion 
(—1, l) is, by (3), 

P(—<¥<)=0(7) (7) 
and 
PI0<%<)=70(z) (8) 


Note that if the expectation a=40, the probability of the ran- 
dom variable x falling in the interval (a, B), will be expressed 


as follows in terms of the probable error E [see formula (4), 
Sec. 8.17]: 


Pa <z< p= [@(0&=*)—o(p*)| (9) 


This equation is expressed in terms of the reduced Laplace func- 
tion as follows: 


P(a<z<p)=z (6 (4 *)—6(4*)| (10) 
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8.20 THE THREE-SIGMA RULE. 
ERROR DISTRIBUTION 


In practical computations, the unit of measurement of the devia- 
tion of a normally distributed random variable from the centre of 
dispersion (the mathematical expectation) is taken to be 
the root-mean-square (standard) deviation o. Then, by formula (7), 
Sec. 8.17, we get some useful equations: 


P(—o<x< 0) = (7) = 0.683 


V2 
P(—20 < x < 20)=@ (V 2) = 0.954 
P(—30 <x < 30)=0 (FT) = 0.997 


These results are depicted geometrically in Fig. 190. 

We can be almost certain that the random variable (error) will 
not depart from the absolute value of the expectation by more 
than 30. This proposition is called the three-sigma rule. 


f(z) 


7 NN 0022 N 
26-6 o 6 26 gee  -4E-3E-2E-EO0l £ 2E3E 4E £ 
Fig. 190 Fig. 191 
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In gunfire theory and in the processing of various statistical 
data it is often useful to know the probability of the random 
variable x falling in the intervals (0, E), (E, 2E), (2E, 3E), (3E, 4E), 
(4E, 5E) for the density function defined by (1), Sec. 8.19. In 
many cases, a knowledge of these probabilities reduces computa- 
tions and helps in the analysis of the phenomena. 

In computing these probabilities, we will use formula (8), Sec. 8.19, 


and the table of the function « (x): 
P(0<x < E)=46(1) =0.2500 
P(E <x <2) =+4 [Ê (2)—6(1)] ~0.1613 
P (2E <x <3E)=+4 [6 (3)— Ê (2)] = 0.0672 
P(3E <x < 4£)=+ [Ô (4)— Ô (3)] =0.0180 


P (4E <x < œ) =~ [® (co) —6 (4)] = 4 (1 — 0.9930) 
= 0.0035 


8.21 Mean Arithmetic Error 497 


The results of the computations are geometrically represented in 
Fig. 191, which is called the error distribution. These calculations 
imply that it is practically a certainty that a value of the 
random variable will fall in the interval (—4E, 4E). The proba- 
bility that this value of the random variable will fall outside that 
interval is less than 0.01. 


Example 1. One shot is fired at a strip 100 metres wide aimed at the middle 
line of the strip perpendicular to the plane of the path of the projectile. Dis- 
persion obeys the normal law with lon- 
gitudinal probable error E=20 metres. 
Determine the probability of hitting the 
strip (Fig. 192). In gunfire theory, the 
longitudinal probable error is denoted by 
Bion, the lateral probable error by Biat- 

Solution. Take advantage of formula 
(7), Sec. 8.19. In our case /=50 metres, 
E = Bion = 20 metres. Hence 


P (— 50 < x < 50) = Ô = 
= Ô (2.5) = 0.9082 ~ 0.91 Fig. 192 


Note. An approximate solution 


may be obtained without resorting to tables of the function ® (x), 
simply by using the error distribution (Fig. 191). In our case, 
l=2.5E, hence 


P (—50 < x < 50) = 2 (0.25 +0.16 + 0.04) = 0.90 


Example 2. Experiment shows that the error of an instrument used for 
measuring distances obeys the normal distribution law with probable error E = 10 
metres. Find the probability that the distance determined by this instrument 
will depart from the true distance by no more than 15 metres. 


Solution. Here, /=15m, E=10m. By formula (7), Sec. 8.19, we get 


P(—15 <x < 15)=0 (3)=% (1.5) = 0.6883 ~0.69 


8.21 MEAN ARITHMETIC ERROR 


To characterize errors we introduce the concept of the mean 
arithmetic error, which is equal to the expectation of the absolute 
value of the errors. We denote the mean arithmetic error by d. 
Let us determine the mean arithmetic error if the errors x obey 
the normal law (4), Sec. 8.15. By a formula similar to (2) of 
Sec. 8.15, we get (a = 0) 


d= | x farene( A); ea [exp (=i) 


=- E [rex (5) = aE 


32—2082 
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Thus, the mean arithmetic error is expressed in terms of the root- 
mean-square (standard) deviation o thus: 


=e = eye (1) 


8.22 MODULUS OF PRECISION. 
RELATIONSHIPS BETWEEN THE CHARACTERISTICS 
OF THE DISTRIBUTION OF ERRORS 


In many processes, particularly in gunfire theory, the probabi- 
lity density function of the normal law is given as 


f (x)= 
Comparing (4), Sec. 8.15, and (1) of this section we see that the 


newly introduced parameter h is expressed in terms of the para- 
meter o thus: 


= en hist (1) 


1 
= ae (2) 


The quantity A is inversely proportional to o, that is, it is inver- 
sely proportional to the mean-square error or the standard devi- 
ation. The smaller the variance o?, that is, the smaller the disper- 
sion, the greater the value of h. For this reason, h is termed the 
modulus of precision. 

From (2) of this section and (1) of Sec. 8.21 we get 


=; yF (3) 
1 
d= (4) 


The probable error E is expressed in terms of the modulus of 
precision h via formula (7), Sec. 8.18, and (3): 


E= (5) 


It is sometimes necessary to express one characteristic of error 
distribution in terms of another. The following equations are found 
to be useful: 


E 5 E = o EJ 
==pV 2 =0.6745, es ae = Vz- 
| 


= 1.4826, = 1.1829 


E pv? E 
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8.23 TWO-DIMENSIONAL RANDOM VARIABLES 


Two-dimensional random variables are involved for example when 
considering the process of target destruction on a plane (xOy). 

The value of a two-dimensional random variable is determined 
by two numbers: x and y. We will denote the two-dimensional 


random variable itself by (x, y). Let x and y assume discrete values 
x; and y;. Let each pair of values (x,, y;) of a certain set be asso- 
ciated with a definite probability p; We can form a table of 
aed distribution of the discrete two-dimensional random 
variable: 


> È pyj=! (1) 


Now let us determine a continuous two-dimensional random vari- 
able. The probability that a value of the two-dimensional random 


variable (x, y) satisfies the inequalities x < x<x+ Ax, y<y J< 


< y+ Ay will be denoted thus: P (x < x < x+ Ax, y < y < y + Ay). 
Definition 1. The function f (x, y) is called the probability density 


function of the two-dimensional random variable (x, y) if, to within 
infinitesimals of higher order than Ap = V Ax? + Ay?, the following 
equation holds true:. 


P(x<x<x+Ax, y<y<y+Ay) ~f(x,y)AxdAy (2) 
Formula (2) is similar to formula (2) of Sec. 8.12. 


We consider a rectangular coordinate system (xOy). If the values 


of the random variable (x, y) are denoted by points of the plane 
having the appropriate coordinates x and y, then the expression 


500 Ch. 8 The Theory of Probability 


P(x<x<x+Ax, y <y < y+ Ay) denotes the probability that the 
two-dimensional random variable (x, y) will assume a value denoted 
by a point lying in the hatched rectangle As (Fig. 193). We will 
say that the “value of the random va- 
riable lies in the domain As”.* 
Cat ies The probability P(x < x< x+ Ax, 
y <y < y+ Ay) will also be denoted 
by P [(x, y)CAs]. Using this notá- 
tion, we can rewrite (2) as 

P(x, y)cAs] = F(x, y) As (3) 
We will now prove the following the- 
orem, which is analogous to Theorem 1, Sec. 8.12. 

Theorem 1. The probability P [(x, y= D] that a two-dimensional 
random variable (x, y) with density function f (x, y) will be in domain 
a is expressed by the double integral of the function f(x, y) over D, 
that is, 


X THAT =X 
Fig. 193 


P [(x, y) cD] = J j f (x, y) dx dy (4) 


Proof. Partition D into subdomains As, as is done in the theory 
of double integrals. For each subdomain we write (3) and add the 
left-hand and right-hand members of the resulting equations. Since 


> As=D and DP [(x, y)cAs] =P [(x, y) D] 


we get an approximate equation to within infinitesimals of higher 
order than As: 
re + ak ‘al 
P(x, yD) ~ DF (x, y) As 


Passing to the limit in the right-hand member of this equation 
as As—+0, we get on the right a double integral and, on the 
basis of the properties of an integral sum, the exact equation 


P [(x, DED] = $ F(x, y) dxdy 
D 
The proof is complete. 
Note 1. If the domain D is a rectangle bounded by the straight 
lines x=a, x= 6, y=y, y=5 (Fig. 194), then 


p ô 
Pla<x<B, y<y <ô] = Í $ f(x, y)dxdy (5) 
ay 


* The shape of the subdomain in (3) may be arbitrary. 
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Note 2. Like (1), the following equation 
f § Fæ yaxdyx1 (6) 
holds true since it is a certainty that the two-dimensional variable 
will assume some value. We put f(x, y)=0 wherever the function 
f (x, y) is not defined by the meaning of the problem. 


Fig. 194 Fig. 195 


If the domain D is the sum of rectangles of the kind shown 
in Fig. 195, then the probability of the random variable falling 
in such a domain is défined as the sum of the probabilities for 
the separate rectangles, that is, as the sum of definite integrals 
over each rectangle: 


P [(x, cD] =P [(x, c D,] + P[(x, yo D,] +P [(x, y) Dy] 


Example. The density function of a two-dimensional random variable is 
given ay the formula 


l 
[E D= eF 


Find the probability that a value of the random variable will fall in the rectangle 
bounded by the straight lines x=0, x=1, y= TF y= V3. 


Solution. By formula (5) we obtain 


1⁄7 
P - l yzl == _ dxedy 
AE Paa eye) 
1 

ve 
i 1 V3 i Pe 
= |F a) ot — arctan x s arctan y a 
0 Lla v7 

v3 


"E 


ela 
| 
o 
< 
TN 
wa 
| 
ola 
~x 
I 
$| — 
R 
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Definition 2. The function 
y x 
F(x, y)= | | Flu, v)dudv (7) 
is termed the distribution function of probabilities of the two- 


dimensional random variable (x, y) 
It is clear that the distribution function expresses the probabi- 


lity that x< x, y <y, that is, 


7/777 F (x, Y=P(x< x, y < y) 
E Y, Geometrically, the distribution function 
x 


expresses the probability that a two-di- 


mensional random variable lies in the 
infinite rectangle hatched in Fig. 196. 
By the theorem on the differentiation 


— 196 of a definite integral with respect to a pa- 
E- rameter, a relation is established between 
the density function and the distribution function: 


yY 
OF 
= ,u)d 
5 ae f (x, v) du 8 


The probability density function of a two-dimensional random 
variable is the mixed second derivative of the distribution function. 


8.24 NORMAL DISTRIBUTION IN THE PLANE 


Definition 1. The distribution of a two-dimensional random 
variable is termed normal if the density function of this variable 
is expressed by the formula 

xe y? 
F D= saa eX pA) (1) 
The graph of this function is a surface (see Fig. 197). 

The centre of dispersion of a random variable with distribution 
law (1) is the point (0, 0).* o, and o, are called the principal 
standard deviations. 


* If the centre of dispersion lies at the point (a, b), then the distribution 


is given by the formula 

(x—a)} _(y—b} ‘ 
x, = ex ag iE E. a aA l 

F(x, y= P| 27 202 ] a’) 


m xOy 
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Rewrite formula (1) as follows: 
f(s, v) =e exp (— 35) — ee exo(—4) (2) 
f ox V 20 20%/ oy V 2x 204 
Thus, f(x,y) may be regarded as a product of two density func- 
tions of normally distributed random variables x and y. As in the 


Fig. 197 


case of a one-dimensional random variable, we define the principal 
probable errors, E, and E, [see formula (7), Sec. 8.18] as follows: 


E, =: 00, V 2, E; =p0; V2 (3) 


Substituting o, and o,, expressed in terms of E, and E,, into 
formula (1), we get 


open ee far 7 ure Ie ea 
Fe ) = apg, exp| —e aal] (4) 
Let us consider the level lines of the surface (4): 

Be aa phe 

Et EE k? = constant (5) 


(here, f(x, y)= const]. The level lines are ellipses with semiaxes 
equal to kE, and kE,. The centres of the ellipses coincide with 
the centre of dispersion. These ellipses are called ellipses of disper- 
sion. Their axes are termed axes of dispersion. The unit ellipse of 
dispersion is an ellipse whose semiaxes are equal to the probable 
errors E, and E,. The equation of the unit ellipse is obtained by 
putting k=1 in equation (5): 


$+ =] (6) 


The żotal ellipse of dispersion is an ellipse whose semiaxes are 
equal to 4E, and 4E,. The equation of this ellipse is 


x2 2 
GE, TUEJ ! (7) 
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In the next section we will establish the fact that the proba- 
bility of a two-dimensional random variable falling in the total 
ellipse of dispersion is equal to 0.97, which makes a hit a practical 
certainty. 


8.25 THE PROBABILITY OF A TWO-DIMENSIONAL 
RANDOM VARIABLE FALLING IN A RECTANGLE WITH SIDES PARALLEL 
TO THE PRINCIPAL AXES OF DISPERSION UNDER THE NORMAL 
DISTRIBUTION LAW 


Let : ; ; 
Pt —p fs 
By formula (5), Sec. 8.23 (see Fig. 194), the probability of a random 


variable falling in the rectangle bounded by the straight lines 
x=a, x= 8, y=y, y =ô is expressed thus: 


Ei 


B ò 
- - 2 2 2 
Pa<%<B,y<y <6)=|( sep exp |—e'(S +) | dedy (1) 
ay 


Representing the integrand as a product of two functions, we can 
write 


Pa<x<fB, y<y <5) 


B ð 
= p _ 2 p apt 
J Vaz, (—e a) a | peer A 
X 
and, on the basis of formula (6), Sec. 8.19, we finally get 
Pa<x<B, Y<y <6) 


-+[6(2)-9(2)][9(8)-2(2)] o 


If we put &a=— l, B=., y=—J,, =l, here, that is, if we 
regard a rectangle with centre at the origin, then by (7), Sec. 8.19, 
formula (3) will take the form 


P(-A <<, —h <9 <= (E) (E) z 


Note. The problem on the probability of a random variable 
falling in a rectangle with sides parallel to the coordinate axes 
could also be solved in the following manner. Falling in the 
rectangle is a compound event consisting in the coincidence of 
two independent events: falling in the strip —l<x<l, and 
falling in the strip — l, < y< l,. (To save space, we consider a 
rectangle with centre at the origin.) Let the density function of 
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the random variable x be 


a—_ P _ ae 
f= sree exp (— 6°) 
The density function of the random variable y is 
= l — 2 8? 
fw) = aq exP (e) 
We compute the probability of the random variable falling in 


the strip —l, <x < l, and in the strip — l} < y < la. By formula 
(7), Sec. 8.19, we get : 
1 


P(—4<¥<h)=Ôô (5) 


P(—h<y<l)= (7) 


The probability of a compound event— falling in the rectangle — 
is equal to the product of the probabilities: 


P(a<x<p, y<y<6)=P(—1, <x <1,)P(—h, <y < l) 


=6(4) (4 
We have obtained formula (4). (z; Ex, ( h) 


Example. Shots are fired at a rectangle with sides 200 m and 100 m bounded 
by the lines 


x=—100, x= 100, y = —50, y=50 


The principal mean errors are equal to E,= Bion =50 metres and E} = Biat 
= 10 metres, respectively. Find the probability. “of hitting the rectangle in a 
single shot (Fig. 198). 


Solution. In our case 
1,= 100, 1,=50, E,=50, Ey=10 
Putting these values into (4) and using the table of values of the function ® (x) 
(see Table 1 of the Appendix), we find 


Bee (T) 6(%)= Ô (2). (5) = 0.8227 -0.9993 = 0.8221 
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8.26 THE PROBABILITY OF A TWO-DIMENSIONAL RANDOM 
VARIABLE FALLING IN THE ELLIPSE OF DISPERSION 


In the theory of errors one comes up against the following problem. 
It is required to compute the probability that a random variable, 
say, an error in the plane, will fall in the ellipse of dispersion 


£ _ ps (1) 


if the density function is given by formula (4), Sec. 8.24. By (4) 
of Sec. 8.23, we get 


P[(x, cD] Sasa |e a) dxdy (2) 


el 


where the domain D,, is bounded by the ellipse (1). We make 
the change of variables 


x=E,u, y=Eyv 
Then the ellipse D,, will be carried into the circle 
u? + v2 =k? (3) 
Since the Jacobian of the transformation is equal to /=E,-E,, 
equation (2) becomes 
P[(, Dz] =~ | pre et H+ du dv (4) 
Dk 
In the last integral we pass to polar coordinates 
u=rcosọ, v=rsing 
Then the right member of (4) takes the form 
27k 


P [&, WCDul =z |È pre-e r drdp 
00 
Carrying out the computations in the right member, we get the 
expression of the probability of falling in the ellipse of dispersion: 
P [(x, YED] = 1—70 (5) 


Let us consider some particular cases. The probability of falling 
in the unit ellipse of dispersion occurs if we put k = 1 in formula (5) 


P(x, Y)cDalk=ı = 1 —e7® = 0.203 (6) 


The probability of falling in the total ellipse of dispersion (7), 
Sec. 8.24, occurs if in (5) we put k=4: 


P(x, y)CDeiJeca= 1 — e7 180" = 0.974 (7) 
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Let us consider the particular case where in (4), Sec. 8.24, 
E ,=E,=E. The ellipse of dispersion (5), Sec. 8.24, turns into 
circle : 

Lp = kE (8) 


with radius R=kE. The probability of a two-dimensional random 
variable falling in a circle of radius R is, in accord with (5), 


P [(¥, EDR] = 1—exp (—p* Fr) (9) 


Definition 1. The mean radial error is a number Ep such that 
the probability of a two-dimensional variable falling in a circle 


of radius R= Ep is equal to ok 


The definition implies that the quantity R= Epę is determined 
from the relation 


E? l 


From a table of values of the exponential function we find 
Eg = 1.75E 


8.27 PROBLEMS OF MATHEMATICAL STATISTICS. 
STATISTICAL DATA 


Statistical data are obtained as a result of observation and record- 
ing of mass random (chance) phenomena. An instance of such data 
are the errors of measurement. 

If an observed quantity is a random variable, then it is studied 
by the methods of probability theory. To grasp the nature of this 
random variable, one has to know its distribution law. Determin- 
ing the laws of distribution of such quantities and estimating the 
values of the parameters of distribution on the basis of observed 
values constitutes a problem in mathernatical statistics. 

Another problem of mathematical statistics is the establishment 
of methods of processing and analyzing statistical data to obtain 
certain conclusions necessary in organizing an optimal process 
involving the quantities under consideration. 

The following are some illustrative examples of observations of 
phenomena that yield statistical data. 


Example 1. The distance to an object is measured a large number of times 
with the aid of a measuring instrument yielding a series of values of the observed 
quantity. They are called observed values (we will use this term for any value 
obtained in studying any phenomenon). 


The values thus obtained require systematization and processing 
before any conclusions can be drawn from them. 


508 Ch. 8 The Theory of Probability 


As has already been pointed out, the difference ô between an 
observed value x and the true value of the observed quantity 
a(x—a=65) is called the error of measurement. The errors of 
measurement require mathematical processing in order to obtain 
specific conclusions. 


Examp!e 2. In mass production one has to consider the amount of deviation 
of a certain dimension of a finished article (say, length) from a given dimension 
(fabrication error). 

Example 3. The difference between the coordinate of the point of impact in 
gunfire and the coordinate of the target is the error of gunfire (dispersion). These 
errors require mathematical investigation. 

Example 4. The results of measurements of the amount of departure of the 
dimensions of an item after a period of operation from its dimensions prior to 
operation (design dimensions) require mathematical analysis. Such deviations 
can also be regarded as “errors”. 


It is clear from the foregoing that these quantities are random 
variables and each observed value should be regarded as a particular 
value of the random variable. 

For instance, the range error (dispersion) in gunfire is determined 
by the error obtained when weighing the charge, the error in weight 
in the manufacturing process, the aiming error, the range determin- 
ing error, variations in weather conditions, and so forth. All these 
are random variables, and dispersion, as the result of their joint 
action, is also a random variable. 


8.28 STATISTICAL SERIES. HISTOGRAM 


The statistical findings obtained in observations (measurements) 
are tabulated in two rows. The first row contains the number i 
of the measurement, the second, the value x; of the quantity x 
being measured: 


This table is called a simple statistical series. If there are a 
large number of measurements, the statistical data is not readily 
surveyable and an analysis is complicated. Therefore, the data 
obtained from a simple statistical series are given in a frequency 
table. This is done in the following manner. 

The whole interval of values of the quantity x is partitioned 
into subintervals of equal length (a,, a,), (a,, a), ..., (Qa-1, Qa) 
and then we count the number of values m, of x falling in the 
interval (a,_,, @,). The values at the end of the interval are referred 
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either to the left or right intervals (sometimes half is placed in 
the left interval and half in the right). The number 


Tespi ° (1) 


is the relative frequency corresponding to the interval (a,_,, a,). 
Clearly, 


rw 
X p= (2) 


Having processed the data in this manner, we then construct 
a table consisting of three rows. The first row indicates the intervals 
in order of increasing a,, the second row, the corresponding numbers 


m,, and the third row, the frequencies p, == Te, 


Intervals 


This is what is called the frequency table. It may be converted 
into a een as follows. On the x-axis we mark off points a,, 
As -s Gp, «.-, Q@. On each interval [a,_ v aç] as a base, we 
construct : rectangle whose area is equal to pg. The resulting figure 
is called a histogram (Fig. 199). 


Qo Q, Ola, a, a, A, ag A, Ags 
Fig. 199 


On the basis of the frequency table and the histogram we can 
give an approximate construction of a statistical distribution function. 
The processing is continued as follows. The midvalues of the 
intervals (a,_,, Q) are denoted by x, and this value is taken to 
be the value of the measurement, which is repeated m, times. Then 
in place of the frequency table we construct the following table: 
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This procedure is based on the fact that all values in the interval 
(a,-,, a) are close-lying values and are therefore considered to be 
equal to the abscissa of the midvalue of the interval xè. 


Example. One hundred range measurements were made yielding the following 
results (frequency table): 


o o o o o e [=] 

> +t ~ o ao o a a 

bozi i ot N N N N on 

Intervals 7 1 | 1 l 1 l ! 
I (= o i) © ° o o 

D - +t `~ ec M © a 

© = ~ _ N N N N 


a| | a | 6 


0.02 | 0.05 | 0.16 | 0.24 | 0.28 | 0.18 | 0.06 | 0.01 


80 110 140 170 200 230 260 290 320 x 
Fig. 200 
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We then construct the following table: 


215 | 245 | 275 305 


8.29 DETERMINING A SUITABLE VALUE 
OF A MEASURED QUANTITY 


Suppose that in measuring a certain quantity we obtained the 
measurements Xi, Xz, ..., Xp. These values may be regarded as 
particular values of the random variable x. For the suitable value 
of the quantity being measured we take the arithmetic mean of 


the values: 
n 
DEF 
« i=l 


m% = (1) 


n 


The quantity mè is called the statistical mean. 

If the number of measurements n is great, then use is made of 
the tabulated data considered in Sec. 8.28, and mł is computed 
as follows: 


s Fm txa +... +Xrmg+... -Ham 


Erz n 
or, using the notation (1), Sec. 8.28, 


À 
my = D xapi (2) 


This value is termed the weighted mean. 

Note. From now on the results of computations via formulas (1) 
and (2) will be denoted by the same letter. This will also be true 
of formulas (3) and (4). 

It can be proved that, under certain restrictions, the statistical 
mean tends in probability to the expectation of the random variable 
x as n— œ. This assertion follows from the Chebyshev theorem. 

Let us define the statistical variance: * 


Š (x;—m)* 
E ___ (3) 


* Actually, it is better to compute the statistical variance by means of for- 
mula (5) of Sec. 8.30. 


D* = 
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This quantity characterizes the dispersion of values of an observed 
variable. 
If we make use of the material of the tables in Sec. 8.28, then 
the statistical variance is determined from the formula 
a 


D* = 2 (x,— mj)? pi (4) 


This formula is similar to formula (2) of Sec. 8.10. 


Example. Determine the statistical mean and the statistical variance on the 
basis of the statistical data of the Example in Sec. 8.28 
Salution: By formula (2) we get 


ds i 
m= £ - =x Xppe = 95-0.02 + 125-0.05 + 155-0.16 
=1 
3 185-0.24-+215-0.28 + 245-0.18 + 275-0.06 -+305 -0.01 = 201.20 


By formula (4) we obtain 


3 (xr— mx)? a 
D” [x]= E eae" (x~—mz) nS Zkpi— my 


= 952-0.02-+ 125%-0.05 + 1552-0.16-+ 1852-0.24 + 2152-0.28 
-+ 2452.00.18 + 2752-0.06 + 305?- 0.01 — (201.20)? = 1753.56 


8.30 DETERMINING THE PARAMETERS 
OF A DISTRIBUTION LAW. LYAPUNOV’S THEOREM. 
LAPLACE’S THEOREM 


Let x be a random variable, say, the result of a measurement, 
let a be the quantity being measured, and 6, the error of measu- 
rement. Then these quantities are connected by the relation 


ô=x—a, x=a+6 (1) 


Numerous experiments and observations have shown that the errors 
of measurements (after excluding crude errors and after excluding 
any systematic error, that is, an error that is constant for all measu- 
rements—say the instrument error—or that varies by a known law 
from measurement to measurement) obey the normal distribution 
law with centre of distribution at the origin. This is confirmed by 
theoretical arguments as well. 

If a random variable is the sum of a large number of random 
variables, then for certain restrictions the sum obeys the normal 
distribution law. This assertion is stated in the so-called central 
limit theorem of A. M. Lyapunov (1857-1918). The theorem is 
given here in simplified form. 
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Theorem 1. /f independent random variables x,, x,, ..., X, obey 
one and the same distribution law with expectation a (without loss 
of generality, we can assume a=0) and variance o*, then, as n 

n e 
» *i 
t=1 
oyn 
mally distributed (y, is normalized so that M[y,]=0, D [y,] = 1). 

The practical significance of the Lyapunov theorem consists in 
the following. We consider a random variable, say, the deviation 
of a certain quantity from the given quantity. This deviation is 
due to many factors, each of which makes a certain contribution 
to the deviation, say in the case of gunfire, the departure of the 
point of impact from the aiming point is due to the aiming error, 
the range error, the shell-fabrication error, etc. We do not even 
know all of the contributing factors, neither do we know the 
distribution laws of the component random variables. But from the 
Lyapunov theorem it follows that the random variable of the total 
deviation obeys the normal distribution law. 

Lyapunov’s theorem implies that if x,, x,, ..., x, are the 
results of measurements of a certain quantity (each of the x; is 
a random variable), then the random variable, which is the arith- 
metic mean, 


increases without bound, the sum y, = is asymptotically nor- 


Xp xg t+... +X, 
n 


C= 


is asymptotically normally distributed for sufficiently large n if 
the random variables x; obey one and the same distribution law. 

The theorem holds true also for a sum of random variables 
having unlike distribution laws, subject to certain additional con- 
ditions, which as a rule are fulfilled for random variables ordina- 
rily encountered in practical situations. Experience shows that for 
the number of terms of the order of 10, the sum may be regarded 
as normally distributed. 


Let us denote by a and o? the approximate values of the expec- 
tation and variance. We can then write down approximately the 


laws of distribution of the random variables 6 and x: 


1 


O= syg exp (—s) (Paj 


F(x) =e exP |=" (3) 
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On the basis of experimental findings, the parameter a is deter- 
mined from formula (1), Sec. 8.29: 
D i 
pie isl 
n 


a= 


(4) 


This follows from the so-called theorem of Chebyshev (1821-1894). 
Without dwelling on the proof, we note that the parameter o is 
more naturally determined from the following formula instead of 
from (3) of Sec. 8.29: 


2 i=l z 
Ome nl (5) 


Note that the right member in (5) and the right member of (3), 
Sec. 8.29, difer by the factor > which is close to 1 in prac- 
tical problerns. 


Example 1. Write down the expression for the distribution law of the random 
variable on the basis of the measurements given in the Example of Sec. 8.28, 
and the. results of computations carried out in the Example of Sec. 8.29. 

Solution. On the basis of the computations carried out in the Example of 
Sec. 8.29, we obtain 

a= m} =201 
n 100 


E ai a = 
me | D =o e 1754 = 1771 


o= V 1771 x41 


Substituting into (3), we get 


o= 


ne il (x— 201)? 
r= aag e m] 


Note. If a statistical distribution function has been obtained 
for some random variable x, then the question of whether the 
given random variable obeys the normal law or not is sometimes 
settled in the following manner. 

Suppose we have the following values of a random variable: 


S area AE 


Find the arithmetic mean of a by formula (4). Find the values 
of the centred random variable 


Yi» Ya» ates | Yn 


The absolute values of y; are then arranged in a series in in- 
creasing order. If n is odd, then for the probable (mean) error E,, 
in the constructed series of absolute values, we take the absolute 
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n 


>) th + l site; ifn iseven, then for E,, 
we take the arithmetic mean of the absolute values occupying 


sites with numbers + and 5+ l. 


We then form the mean arithmetic error using the formula 


value | y„ | that occupies the ( 


zpi (6) 


yi 
5 -} i=l (7) 


And then we find the ratios Ē2 and En, 
oO 


For a random variable that obeys the normal law, the ratios + 


and 2 are equal, respectively, to 0.8453 and 0.6745 [see formula 
o 


(6), Sec. 8.22]. If the ratios 24 and En differ from 0.8453 and 
o 

0.6745 by a quantity of the order of 10%, then it is agreed, con- 

ditionally, that the random variable y obeys the normal law. 

A corollary to the central limit theorem is an important theorem 
of Laplace concerning the probability that an event will occur not 
less than æ times and no more than f times. We give this theorem 
without proof. 

Theorem 2 (Laplace). /f n independent trials are made in each 
of which the probability of occurrence of event A is p, then the 
following relation holds true: 


5 1 p—np a—np 
D2 [PEV OUVE) | 
where m is the number of occurrences of A,q=1—p,and P (a < m<f) 
is the probability that the number of occurrences of A lies between 
a and fp. 
The function ® (x) is defined in Sec. 8.17. 
We will demonstrate the use of the Laplace theorem in the 
solution of problems. 


Example 2. The probability of defective items in the production of certain 


articles is p=0.01. Determine the probability that in 1000 articles there will be 
no more than 20 defective items. 


33 * 
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Solution. Here, 
n=1000, p=0.01, g=0.99, a=0, B=20 


We then find 
ee ee a 
V2Vnpq V2V99 
B—np 20—10 =2.95 


By formula (8) we get 
PO<m< 20) = [o (2.25)— ® (—2.25)] = Q (2.25) 


Using the table of the function (x), we find 
P (0 < m < 20) = 0.9985 


Note that the theorems of Bernoulli, Lyapunov, Chebyshev, and Laplace dis- 
cussed above constitute what is known as the law of large numbers in probability 
theory. 


Exercises on Chapter 8 


1. Two dice are thrown at one time. Find the probability that a sum of 5 
will turn up. Ans. 1/9. 

2. There are 10 tickets in a lottery: 5 wins and 5 losses. Take two tickets. 
What is the probability of a win? Ans. 7/9. 

3. A die is thrown 5 times. What is the probability that a number of four 
will turn up at least once? Ans. 0.99987. 

4. The probability of hitting an aircraft with a rifle is 0.004. How many 
men must shoot so that the probability of a hit becomes > 70%? Ans. n > 300. 

5. Two guns fire at the same target. The probability of a hit from the first 
gun is 0.7, from the second one, 0.6. Determine the probability of at least one 
hit. Ans. 0.88. 

6. One hundred cards are numbered from 1 to 100. Find the probability 
that a randomly chosen card has the digit 5. Ans. 0,19. 

7. There are 4 machines. The probability that a machine is in operation at 
an arbitrary time ¢ is equal to 0.9. Find the probability that at time ¢ at 
least one machine is working Ans, 0.9999. 

8. The probability of hitting a target is p=0.9. Find the probability that 
in three shots there wil!’be three hits. Ans. ~ 0.73. 

9. Box One contains 30% first-grade articles, Box Two contains 40% first- 
grade articles. One article is drawn from each box. Find the probability that 
both drawn articles are first-grade. Ans. 0.12. 

10. A mechanism consists of three parts. The probability of defective items 
in the manufacture of the first part is p,-=0.008, the probability of defectives 
in the second part is pa = 0.012, the probability of defectives in the third part 
is p3==0.01. Find the probability that the whole mechanism is defective. 
Ans. 0.03. 

11. The probability of a hit in a single shot is p==0.6. Determine the pro- 
bability that three shots will yield at least one hit. Ans. 0.936. 

12. Out of a total of 350 machines, there are 160 of grade One, 110 of grade 
Two, and 80 of grade Three. The probability of defectives in the grade-one 
category is 0.01, in the grade-two category, 0.02, in the grade-three category, 
Vea one machine. Determine the probability that it is acceptable. 

ns. 0.98. 

13, Suppose it is known that due to errors committed in preparation for gunfire, 
the centre of dispersion of the shells (CDS) in the first shot can lie at (in range) 
one of five points. The probabilities that the CDS will lie at these points are equal 
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to p,=0.1, py=0.2, pg=+0.4, py==0.2, p,=0.1. It is also known that if the 
CDS lies in the first point, the probability (in range) of hitting the target will 
be p,==0.15. For the other points we will have for this case: p,==0.25, p = 
= 0.60, py=0.25, p,=0.15. e 

In the initial adjustment of sight, a shot was fired with a miss in tange. 
Determine the probability that the shot is made at adjustment of sight corre- 
sponding to each of the five indicated points of the CDS, that is, determine the 
probabilities of causes (hypotheses) concerning distinct errors in the position of 
the CDS after a trial (shot). Ans. 0.85, 0.75, 0.40, 0.75, 0.85. 

14. A die is thrown 5 times. What is the probability that a six will turn 
up twice and a non-six three times? Ans. 625 3888. 

15. Six shots are fired. Find the probability that not all are plus rounds if 
the probability of a plus round is p=1/2, the probability of a minus round is 
q= l/2 (gunfire at a “narrow” target). Ans. 31/32. 

16. Referring to the conditions of the preceding problem, determine the pro- 
bability that there will be three plus rounds and three minus rounds. Ans. 5/16, 

17. Find the mathematical expectation of the number that turns up in a 
single toss of a die. Ans. 7/2. 

18. Find the variance of a random variable x given by the following distri- 
bution table: 


x 


2 | 3 | 5 
| o.i | 06 | 03 


Ans. 1.05. 

19. The probability of occurrence of event A in a single trial is equal to 0.4. 
Five independent trials are carried out. Find the variance of the number of 
occurrences of A. Ans. 1.2. 

20. In a case of gunfire at a target, the probability of a hit is 0.8. The fire 
is kept up till a first hit. There are 4 shells. Find the expectation of the number 
of shells used. Ans. 1.242. 

21. In firing at a “narrow” target, the probability of a plus round is p=1/4, 
the probability of a minus round is qg=3,4. Find the probability of a combi- 
nation of two plus rounds and 4 minus rounds in six shots. Ans. 0.297. 

22. The probability that an article will be defective is p =0.01. What is the 
probability that a batch of 10 articles will yield 0, 1, 2, 3 defectives? Ans. 0.9045, 
0,0904, 0.0041, 0.0011. 

23. Find the probabilities of obtaining at least one hit in the case of 10 shots 
if the probability of hitting the target in a single shot is p=0.15. Ans. 1 — 
— (0.85)!" = 0.803. 

24. A random variable x is given by the distribution function 


0 for «<0 
F(x)=¢ x for O<x=l 
1 for l<x 


Find the density function f(x), M [x], D [x]. 


0 for x <0 
Ans. f(x)=¢ 1 for O<x<l, Mi=} 
2 

0 for I<x 


1 
’ D k= 
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25. A random variable x obeys the normal law with expectation 30 and 
variance 100. Find the probability that the value of the random variable lies 
in the interval (10, 50). Ans. 0.954. 

26. A random variable obeys the normal distribution law with variance 
o?=0.16. Find the probability that a value of the random variable will differ 
in absolute value from the mathematical expectation by less than 0.3. Ans. 0.5468. 

27. A random variable x is normally distributed with centre of dispersion 
a=—0.3 and modulus of precision h=2. Find the probability of a hit in the 
interval (0.5, 2.0). Ans. 0.262. 

28. Gunfire is conducted at a strip of width 4 metres. There is a syste- 
matic error in aiming of 1 metre (undershooting). The probable error is 5 metres. 
Find the probability of hitting the strip in the case of normal dispersion. 
Ans. 0.211. 

29. Fire is conducted at a rectangle bounded by the straight lines x, = 10 m, 
Xg=20m, y,=15m, ye=35m, in the direction of the straight line bisecting 
the short side. The probable errors of normal distribution on the plane are 
E,=5m, Ey=10m. Find the probability of a hit in a single shot. Ans. 0.25. 

30. An error in the fabrication of an article with a given length 20 cm is 
a normally distributed random variable; o =0.2 cm. Determine the probability 
that the length of a manufactured article will differ from the given value by 
less than 0.3 cm. Ans. 0.866. 

31. Under the hypotheses of Example 30, determine the fabrication error that 
has probability 0.95 of not being exceeded. Ans. 0.392. 

32. A random variable x is normally distributed with parameters M [x] =5 
and o=2. Determine the probability that the random variable will lie in the 
interval (1, 10). Make a drawing. Ans. 0.971. p 

33. The length of an article made on an automatic machine is a normally 
distributed random variable with parameters M [x] = 15, o=0.2. Find the pro- 
bability of defective output if the tolerance is 15 + 0.3. What accuracy of length 
of the article can be guaranteed with probability 0.97? Make a drawing. 

34. In measuring a certain quantity we get the following statistical series: 


Relative 
frequency 


Determine the statistical mean and the statistical variance. Ans. 2 and 1. 
35. The results of measurements are tabulated as follows: 


Relative 
frequency] 


Find the statistical mean a and the statistical variance o2. Ans. 0.226, 0.004. 
36. The probability of defective production is p=0.02. Find the probability 
that in a batch of 400 parts there will be from 7 to 10 defectives. Ans. 0.414. 


37. The probability of a hit is p=. What is the probability that in 250 


shots the number of hits will lie between 100 and 150? Ans. 0.998. 
38. The probability of defective production is p=0.02. Find the probability 
that among 1000 items there will be not more than 25 defectives. Ans. 0.87. 


CHAPTER 9 


MATRICES 


9.1 LINEAR TRANSFORMATIONS. MATRIX NOTATION 


Consider two planes P and Q. Given in the P plane is a rectan- 
gular system of coordinates x,Ox,, in the Q plane, a system y,Oy,. 

The P and Q planes can be brought to coincidence and so can 
the coordinate systems. Let us consider the following system of 
equations: : 


Yı = Ay, X, FAX, } 
Yo = Any Xy F Aate 


(1) 


By (1), to each point M (x,, x,) of the x,x,-plane there corresponds 
a point M (y,, y,) of the y,y,-plane. 

We say that equations (1) constitute linear transformations of 
the coordinates. These equations map the x,x,-plane onto the y,y,- 
plane (not necessarily onto the whole plane). Since the equations 
(1) are linear, the mapping is termed a linear mapping. 


“go ‘id 
0 Ti 0 Y, 
Fig. 201 


If in the x,x,-plane we consider some domain D, then using (1) 


we can define some set of points D of the y,y,-plane (Fig. 201). 
Note that one can also consider nonlinear mappings 


Y= P(X X), Yo= P(X, x) 
In this text we confine ourselves to linear mappings. 
The mapping (1) is fully defined by the set of coefficients a,, 
Aies Qz Qao- 
"A rectangular array of these coefficients can be written hus: 


& a) 
Ay, Ag, 


ay aiz 


Ay, Ag, 
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It is called a matrix of the mapping (1). The symbol || || or () 
is the matrix symbol. 

Matrices are also designated by a single letter, for instance 
A or || Al: 
CETERI 


Azi Azo @) 


A determinant made up of the elements of a matrix, in the order 
they are given in the matrix, is called the determinant of the matrix 
[we denote the determinant by A(A)]: 


= (3) 
Xo) Yz k=3 
PZZ 


Tı 


Fig. 202 Fig. 203 


Example 1. The mapping 
Yı =X, COS Q — Xg SİN Q 
Yz = X; SİN Q + x, COS @ 
is a rotation through the angle a. In this mapping, every point M with polar 
coordinates (p, 8) is carried into point M with polar coordinates (p, O-+ a) if 
the coordinate systems (x,Ox,) and 
£ | Y2 k=3 ate are brought to coincidence (Fig. 


The matrix of this mapping is 
cos.% —sina 


sin @ cos @ 
Example 2. The mapping 


y= kx 
Yo = Xe 


represents a stretching along the x,-axis 
with stretching factor k (Fig. 203). 
The matrix of this mapping is 


Y1 kO 
a=[0 | 
Fig. 204 01 


Example 3. The mapping 


T, 


y=kx 
Yo = Rxz 


is a k-fold stretching both in the direction of the x,-axis and in the direction 
of the x-axis (Fig. 204), 
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The matrix of this mapping is 


ko 
A= 
foal. 
Example 4. The transformation 
n= 4 
Yo = Xa 


is called a mirror reflection in the x,-axis (Fig. 205). 


Fig. 206 


The matrix of this transformation is 


“| 


—!t0 
01 


Yi =X, -FAx 
Y2= Xe 


is termed a simple shear transformation along the x-axis (Fig. 206). The matrix 
of this transformation is 


Example 5. The transformation 


LA 


le ee 


We can consider a linear transformation with an arbitrary number 
of variables. 
Thus, the transformation 
Yı = yy Xy F Ay 2X, + Ay 5%, 
Yo = Ag XT AgXy + AyyXy (4) 
Y3 = A31X1 F 32X2 + Ag 5Xy 
is a mapping of three-dimensional space (x,, Xa, x,) into the three- 
dimensional space (y,, Y2, y,;). The matrix of this transformation: is 
Gy, Ay, Qiz 
A = || Aq; Aag Q33 (5) 
azı Asz a33 
It is also possible to consider linear transformations with a non- 
square matrix, which is a matrix where the number of rows differs 
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from the number of columns. The transformation 
Yı = 11% + 4%, | 
Yo = Ay, X + A22% 
Yz = 451% + aza 
is a mapping of the x,x,-plane into a certain set of points in the 
space (Yı, Yo. Y 
Here, the matrix of the transformation is 
ay aiz 
A= Ay, Age (7) 
Q31 Az. 
It is also possible to consider matrices with arbitrary numbers 
of rows and columns. Matrices find application outside of linear 
transformations. For this reason, a matrix is an independent mathe- 


matical. concept similar to that of a determinant. We now give 
some definitions involving the matrix concept. 


(6) 


9.2 GENERAL DEFINITIONS INVOLVING MATRICES 


Definition 1. A rectangular array of mn numbers consisting of m 
rows and n columns, 


ay, aiz Qin 
Aes 2, See eos . (1) 
Anı Ima +++ Amn 
is termed a matrix. A matrix is also denoted briefly as 
A=|l\a;;\| ((=1, 2, ...,m; j=1, 2, ..., 0) (2) 


where a,, are the entries (elements) of the matrix. 
If the number of rows in a matrix is equal to the number of 
columns, m=n, then we have a square matrix: 


Qir Ayn >- Ain 


ate sah (3) 


. . e e è ù 


any Aang RFS Ann 


Definition 2. A determinant consisting of the elements of a square 
matrix (in the order given in the matrix) is called the determinant 
of the matrix. We denote it by A (A): 


Qir Aiz --- Qin 


A (A) =| an Ger +++ Gon (4) 


any Ane Sah ann 
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Note that a nonsquare matrix does not have a determinant. 
Definition 3. A matrix A* is called the transpose of A if the 


columns of A are the rows of A*. N 
Example. Let 
aii Aig 
A= || da; Q22 
a31 A32 
The transposed matrix A* is then 
A*= 411 Q21 Ag, 
Ai2 A22 A32 


Definition 4. A square matrix A is said to be symmetrie about 
the principal diagonal if a;;=a,;. It.is clear from this that a 
symmetric matrix coincides with its transpose. 

Definition 5. A square matrix whose elements outside the prin- 
cipal diagonal are all zero is called a diagonal matrix. If the 
elements of a diagonal matrix on the principal diagonal are all 
unity, then the matrix is termed a unit matrix (identity matrix) 
and is denoted by E: 


eee 0 

01...0 

E= (5) 
00...1 


Definition 6. We can also consider matrices consisting of a single 
column or a single row: 


“i 


Xa 
X = -j> Y=||4, 42 --- Yall (6) 


Xm 


The former is called a column matrix, the latter, a row matrix. 

Definition 7. Two matrices A and B are considered equal if they 
have the same number of rows and columns and if the correspond- 
ing elements are equal: 


A=B (7) 
if laz || = Ilb; (i=l, 2, sees M; j=l, 2, e... n) (8) 
1 

a=b; (9) 


It is sometimes convenient to identify a column matrix and a 
vector in a space with the corresponding number of dimensions, 
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where the elements of the matrix are the projections of the vector 
on the appropriate coordinate axes. Thus, we can write 

EA 
X2 
x 


=xXi+xJtx,k (10) 


3 


A row matrix is also occasionally conveniently identified with 
a vector. 


9.3 INVERSE TRANSFORMATION 
From equations (1) of Sec. 9.1, 
Yı = QX + 32X3 \ 
— i (1) 
Yo = Ay X + Ag2X, Í 


it follows that the mapping of x,x,-plane into y,y,-plane is one-to- 
one, since each point of the x,x,-plane is associated with a unique 
point of the y,y,-plane. 

If the determinant of the transformation matrix is nonzero, 


ay aiz 


A(A)= 


AO OF das — inl #0 (2) 
Q21 Are 


then, as we know, the system of equations (1) has a unique solu- 
tion for x, and x,: 


Yı Ae a A 
x = Yo Are x — 1 921 Yel 
7 Qi, Ah 3 Ai G12 
a21 Age Q21 Age 
or, expanded, 
n = ys 
=u ay (3) 
nEEH ) 


.To each point M (y,, y,) of the y,y,-plane there corresponds a 
definite point M (x,, x,) of the x,x,-plane. In this case, the mapp- 
ing (1) is termed a one-to-one (nonsingular) mapping. The trans- 
formation of coordinates (y,, y,) into the coordinates te. xa) (3) is 
called an inverse transformation. Here, the inverse mapping is 
linear. Note that a linear nonsingular mapping is called an affine 
mapping. The matrix of an inverse transformation is a matrix which 
we denote by A7?: 


a23 — 0 
Ši A A 
nies 22n Ann (4) 
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If the determinant of the matrix A is equal to zero, 
a,,0,,—4,,0,,=0 (5) 


then the transformation (1) is said to be Singular. In that case, it 
is not a one-to-one transformation. 

We will prove this. Let us consider two possible cases: 

(1) If a,;=a,, = a,,=a,,=0, then for arbitrary x, and x, it will 
be true that y,=0, y,=0. In this case, any point (x,, x,) of the 
x,x,-plane will pass into the origin of the y,y,-plane. 

(2) Let at least one of the coefficients of the transformation be 
different from zero, say a, #0. 

Multiplying the first equation of (1) by a,,, the second by a,, 
and then subtracting, we get [with regard for equation (5)] 


azı | Y1 = 1 1X1 + Ay 0% 
O41 | Ya = G91%1 + A2343 (6) 
9141 — 414, =0 
Thus, given arbitrary x,, x,, we get (6) for the values y, and y, 
that is, the corresponding point of the x,x,-plane falls on the straight 
line (6) of the y,y,-plane. It is clear that this mapping is not a 
one-to-one mapping since each point of the straight line (6) of the 
y,y,-plane is associated with a set of points of the x,x,-plane lying 
on the straight line y, =a,,x,+@,.%,. 
In neither case is the mapping one-to-one. 
Example 1. The transformation 
Yr = 2%, +a 
Y2=%1— X3 
is one-to-one since the determinant A(A) of the transformation matrix A is 
nonzero: 2 i 
sali |= 
The inverse transformation is 
ETTE 
15g "ty Ya 
I 2 
w= Zu g Ya 
The matrix of the inverse transformation is, by formula (4), 
1 | 


3 3 
A-!= 
I o2 
3 3 
Example 2. The linear transformation 
Yi =x, + 2x: 


Ya = 2x, + 4x4 
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in singular, since the determinant of the transformation matrix 
12 
24 


This transformation carries all points of the x,x,-plane into the straight line 
Ya— 2y, =0 of the y,ye-plane. 


A (A) = =0 


9.4 OPERATIONS ON MATRICES, 
ADDITION OF MATRICES 


Definition 1. The sum of two matrices ||a,,|| and ||b;; || having 
the same number of rows and the same number of columns is a 
matrix ||c;; || whose element c;, is the sum a;;-+ 6;, of the correspond- 
ing elements of the matrices ||a;;|| and ||6;;||; that is, 


Laz; ll + lb I] =e, || (1) 
if 
aij +b = Ci (i=l, 2, o i j=1, 2, Sen) (2) 
bir biz aut bi ttbi 


Example 1. 
a21 Age bar baz |- azı +ba aza + boo 


The difference of two matrices is defined in similar fashion. 

The expedience of such a definition of the sum of two matrices 
follows, in particular, from the conception of a vector as a column 
matrix. 

Multiplication of a matrix by a scalar (number). To multiply 
a matrix by a scalar 4, multiply each element of the matrix by 
that scalar: 


Ay, Aig 


AI] ai; || =|] Aas (3) 
If à is integral, then formula (3) is obtained as a consequence 
of the rule for adding matrices. 


Example 2. 
ay, aig 


Nagy Aago 


431 12 |j 


A 


a21 A22 


Product of two matrices. Suppose we have a linear transforma- 
tion of the x,x,-plane into the y,y,-plane: 


Yı = Ay X, + 41X3 \ (4) 
Yo = Ag X, + Ao Xa 
with the transformation matrix 
ii a 
= 5 
Ay, Aag (5) 
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Furthermore, suppose a linear transformation has been performed 
of the y,y,-plane into the z,z,-plane: 


2, =b Y + bih \ 


Za = Oy, + bazha (6) 
with transformation matrix 
b,,6 
B= 11 712 7 
bay baz (7) 


It is required to determine the matrix of the transformation of 
the x,x,-plane into the z,z,-plane. Substituting the expressions (4) 
into (6) we get 

Z, = Dy, (11X, + l12X2) + Oy (Aa 1%1 + Ayo.) 
Za = Dy (Ay 1% + 1X3) + Dog (A21%1 + 4,.%>) 


or 
Z, = (b111, + 94901) X1 + (b118, + D12032) Xe \ (8) 
Z, = (0411 + By5Q51) + (051415 + baaga) Xa 
The matrix of the resulting transformation is 
C= biai $8201 Oy Aye HOr (9) 
baiar F baas 921A, + D220 
or, briefly, 
C= Cy Ce (10) 
Cox Con 


The matrix (9) is called the product of the matrices (7) and (5) 
and we write 


by, by fute] b18, +O yg, O11012 F D12022 (11) 
bia Doe || || G21 aza B44, F braa, 211g + Oreos 
or, briefly, 
B.A=C (12) 


Let us now state the rule for multiplying two matrices B and A 
if the first contains m rows and k columns, and the second, k rows 
and n columns. 

Schematically we have the equation 

bii biz Ew bik ay, Aiz Pane) ay; Paa Ain Cu wire. eA Cin 

Se Be a ais + |] oy Are ++ Qaj +++ Aen =I: a 
bir Oj.» - Dir : eee Ciete (13) 


bmi Ome +++ Ome Akı Aka +++ App - - - Akn Cre seeni Cai 


528 Ch. 9 Matrices 


Element c;; of matrix C, which is the product of matrix B by 
matrix A, is equal to the sum of the products of the elements of 
row i of matrix B by the corresponding elements of column j of 
matrix A; that is, 


k 
= È baa (i=1,2,...,m; j=1,2,...,2) 


Example 3. Suppose 
10 00 
B= = 
lool a-lo 


00 
“o af ol: li ol =[o ol 


(2) aB-|' 10 ol oll: ol 


In this example, 
BA ~ AB 


We therefore conclude that in matrix multiplication the commu- 
tative law does not hold true. 


Example 4. Given the matrices 


100 010 
A=||0 21 B=||2 0 1 
300 101 


Find AB and BA. 
Solution. By formula (13) we have 


1-0+0-2+0-1 1-1+0-0-+0-0 1-0+0-1-10-1 010 
AB=||0-04+2-2+1-1 0-142-04+1-0 0-04+2-1+1-1 |- 503 
3-0+0-2+0-1 3-1+0-0+0:0 3-0+0-1+0-1 030 
0-1+1-0+0-3 0-0+1-2+0-0 0-0+1-1+0-0 021 
BA=|/2-1+0-04+1-3 2-0+0-2+1-0 2-0+0-1+1-0]/=|/5 00 
1-140-0+1-3 1-04+0-2+1-0 1-0+0-1+1-0 400 


Example 5. Find the product of the matrices 


bii bia b 
a11 Ayo A33 Lae 13 
21 ba2 bas 
ears bay baz bs3 


= 1041 + a12b21 + 21303; 411012 + 12000 + A13b32 eee | 
9511+ A22b21 + G2g031 421012 + 222020 + A23b33 A21b13 + A22b23 + A23b33 

By direct verification we see that the following relations for 

matrices are valid (k is a scalar, A, B, C are matrices): 


(kA)-B= A. (kB) (14) 
(A +B):C=A-C+B-C (15) 
C:-(A+B)=CA+CB (16) 


A (BC) = (AB) C (17) 


9.5 Transforming a Vector into Another Vector 529 


From the rules for multiplying a square matrix A by ascalark 
and from the rule for taking out a common factor of the elements 
of the columns of the determinant of a matrix of order n follows 


A (RA) =k" A(A) (18) 
Since multiplication of two square matrices A and B yields a 


square matrix whose elements are formed by the rule for multi- 
plying determinants, the following equation is clearly valid: 


A (AB) = A (A) -A (B) (19) 


Multiplication by the unit matrix. A square matrix whose ele- 
ments on the principal diagonal are all equal to unity and else- 
where are zero (as mentioned above) is a unit matrix. 

For instance, 


10 
= 20 
£ lo | 
is a unit matrix of order two. 
By the rule for multiplication of matrices we get 
AE Aii Aie Ao a, a, 
as; ar ay Qz 
That is, 
AE=A (21) 
and also 
EA=A (22) 


It is easy to see that the product of a square matrix of any 
order by the corresponding unit matrix is equal to the original 
matrix, which means (21) and (22) hold true. In matrix multipli- 
cation, the unit matrix plays the role of unity, whence the namé 
“unit matrix” (or identity matrix). 

The unit matrix (2) is associated with the transformation 


Y= 
Y: =X, 

This is the identity transformation. Conversely, to an identity 
transformation there corresponds a unit (identity) matrix. In simi- 
lar fashion we define the identity transformation of any number of 
variables. 


9.5 TRANSFORMING A VECTOR INTO ANOTHER VECTOR 
BY MEANS OF A MATRIX 


Suppose we have a vector 


X=x i +x J+ xk 
34— 2082 
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which we will write in the form of a column matrix: 
x; 
x, 


x3 


X= (1) 


We transform the projections of this vector with the aid of the 
matrix 
1,2 Ais 
a, Ag, Ay, 
a3, A32 lss 


A= (2) 


to get 
Yo = Ay 1X, + AX + Ay5X, (3) 
Ys = Ag, X%, + AgoXp +.55X, 
This yields a new vector 
Y= yityJd+ Ysk 
which can be written as a column vector thus: 
` Y: 44%, -+ Ay Xo + Qy5%5 
Y: Qoi Xı + AX + a, 5X, 
Y3 a5\%, -+ AgeXe + Ay3X5 
Using the matrix-multiplication rule, we can write down the 
transformation operation as follows: 


Y, = Ay Xy F aiaa + A, 5X, | 


Y= 


(4) 


414, Qiz lig x, a11X1 + Oy2X_ +4 4X, 
Ay, Aze Ao, || © |} Xa |] == || CoyXy + AggXq + AggXy (5) 
a3, Az, lsz Xz Ag Xy + AgaXy + A33X3 

That is, or 6) 


Multiplication of a square matrix by a column matrix yields a 
column matrix with the same number of rows. 

Clearly, the transformation of a three-dimensional vector X into 
the vector Y is another way of saying that three-dimensional space 
is transformed into three-dimensional space. 

Note that the system of equations (3) is obtained from the mat- 
rix equation (4) by equating the elements of the left-hand matrix 
and the right-hand matrix. 

Equation (4) yields a transformation of the vector X into the 
vector Y by the matrix A. 

All the reasoning pertaining to a vector in three-dimensional ° 
space can be carried over to a transformation of vectors in a space 
of any number of dimensions. 
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9.6 INVERSE MATRIX 


Suppose we have a vector X. Let us transform it by means of 
a square matrix A to get a vector Y: 


Y=AX (1) 

Let the determinant of A be nonzero, A(A)=+0. Then the in- 
verse transformation of the vector Y into the vector X exists. 
This transformation is found by solving the system of equations (3), 
Sec. 9.5, for x,, x,, x, The matrix of an inverse transformation is 


an inverse matrix of A. The inverse of A is denoted by A~!. We 
can thus write 


X=A1Y (2) 
Here, X is a column matrix, Y is a column matrix, AX is a 
column matrix, A`! is a square matrix. Substituting into the right 
member of (2) the right member of (1) in place of Y, we get 
X=A-'AX (3) 
Thus, on the vector X we performed a succession of transformations 
with the matrices A and A-!. That is, we carried out a transfor- 
mation by means of a matrix that is equal to a product of matri- 
ces (A-!A). The result is an identity transformation. Hence, the 
matrix A™!A is an identity (unit) matrix: 
: A'A=E (4) 
Equation (3) takes the form 
X=EX (5) 
Theorem 1. /f the matrix A-* is the inverse of the matrix A, 
then A is the inverse of A`, and the following equation holds true: 
A'A = AAt = E (6) 
Proof. Transform both members of (3) by means of A: 
AX=A(A™'A)X 


Using the associative property for matrix multiplication, we can 
write the last equation as 
AX = (AA!) AX 
From this we get 
AA =E (7) 
which completes the proof. 
From equations (4) and (7) it follows that the matrices A and 
A~: are inverses of each other. It also follows therefrom that 
(A=) =A (8) 
34 * 
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Indeed, equation (7) implies that 
A- (A`) -=E 
Comparing this equation with (4), we get equation (8). 


9.7 MATRIX INVERSION 
Suppose we have a nonsingular matrix 
Qir Q12 Ay 
A = || Go, Arz Aes (1) 
Ası Asa As 
a11 A12 A13 
A = A (A) = | aa; azs G23 | 0 (2) 
A31 Ags A33 
We will prove that the inverse matrix A~! will be 
An An As 
A 


2 Aig Age A 
ae @ 
Ais Ags Ass 
A A A 


where A; is the cofactor of the element a;; of the determinant 
A=A(A). 
We find the matrix C as the product of the matrices AA7}: 


Ay, An Ası 
Ay; Ayo Ais see uA 100 
C= AA- = Ag, Age a3 || ° As fa ae =j010 
A31 Age Ags Ais Ass Asa 001 

A A A 


Indeed, by the matrix-multiplication rule, the diagonal elements 
of matrix C are each equal to the sum of the products of the 
elements of a row of the determinant A by the corresponding cofactors 
divided by the determinant A, that is, equal to unity. For example, 
the element c,, is defined as follows: 
C= an AE F ay, A 4 ap Ad = n E Atasi ] 

Each off-dìagonal element is the sum of the products of the elements 
of a row by the cofactors of another row divided by the determi- 
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nant A; thus, for example, element c,, is 


A33 az Ag, + asAg2 + 3A 0 


Con = an AE + yy AB + a, At = My teen tastes 9 9 
This completes the proof. 
Note. The matrix 
Ay, Ag, An 
A=|| Ais Ar Ase (4) 
Ais A23 Aas 


is the adjoint of A. The inverse matrix A~! is expressed in terms 
of the adjoint A as follows: 


Ate Ä 


“A (A) A (5) 


d 


The truth of this equation follows from (3). 


Example. Given a matrix 

120 
031 
012 


A= 


Find the inverse A-! and the adjoint matrix A. 
Solution. We find the determinant of A: 


A(A)=5 
Then we find the cofactors 


Ay=5,  Aye=0, = Ayg=0 

Agy=—4, As2=2, An =—1 

As, =2, Ay=—l, Ag3= 
Hence, by (3), 


baie “et 

5 5 5 

2 1 

cies | a a 
1 3 

One T 


Using formula (4) we find the adjoint matrix 


5—4 2 
T 
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9.8 MATRIX NOTATION FOR SYSTEMS 
OF LINEAR EQUATIONS AND SOLUTIONS OF SYSTEMS 
OF LINEAR EQUATIONS 


The discussion will be conducted for the case of three-dimensional 
space. Suppose we have the following system of linear equations: 
Oy X1-+ 412X23 + AygX3 =d, 
Ay X, + AgyX_ + 23X3 = dy (1) 
a31X1 + a32X3 + Ag3X3 = dy 
We consider three matrices: 
ay Aiz Ais 
A = || azı Azs Q23 (2) 
as, ay, Q33 


X=||x, (3) 
D= |d, (4) 


Then, using the matrix-multiplication rule, we can write system (1) 
in matrix form as follows: 


Ay, A12 Q13 x, d, 
Q21 Age Ags || || Xa || = d, (5) 
A31 A32 A33 X3 d; 


Indeed, in (5), on the left we have a product of two matrices 
which is equal to a column matrix whose elements are defined by (5). 
On the right we again have a column matrix. The two matrices 
are equal if their elements are equal. Equating the corresponding 
elements, we get the system of equations (1). The matrix equation (5) 
is compactly written as 

AX=D (6) 

Example. Write the following system of equations in matrix form: 

Xi + 2x =5 
3x + x3=9 
X_+2x5=8 

Solution. Write matrix A of the system, the solution matrix X and the 

matrix D of constant terms: 


120 xi 5 
A=||[03 1/1, X=ļx |, D=||9 
012 Xy 18 
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In matrix form, this system of linear equations can be written thus: 


12 0]| || x, 5 
03 1j x =119 
012 X3 8 


9.9 SOLVING SYSTEMS OF LINEAR EQUATIONS 
BY THE MATRIX METHOD 


Let the determinant of a matrix A be A(A)=0. Premultiply 
the left and right members of (6), Sec. 9.8, by A™}, the inverse 
of A, to get 


A“AX=A"D (1) 
But 
A“A=E, EX=X 
and so from (1) follows 
X=A™'D (2) 


This equation can, with regard for (5) of Sec. 9.7, be written as 


1 ~ 


X=Ta AD (3) 
or, expanded, 
xy Ay An Aa || |d 
Xə = AA) Ay, Age Aae || || do (4) 
| Xs 13 A23 A33 d; 
Multiplying together the matrices on the right, we get 
xy d,A,,+4,A,,+4,Ay, 
*2l1= Aa) d, Aj, -dA + dsAze (5) 
X3 d, A13 -+de Ass + ds Ass 


Equating the elements of the matrices on the left and on the right, 
we get 


x= dA, +dzA21 +d3A31 
1 A 

_ dAj_-+-deAg0+ dsAge 

GG oe 


(6) 
eo di A13 + dpAos + dsAsa 
a A 
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The solution (6) can be written in terms of determinants 


di aiz aig a11 dı a13 | 
dz Aye A33 a2; dz a23 
= d3 Aso a33 = | 31 ds a33 
l 411 12 813 ? ai Arz g| ’ 
A») Age Aog a21 Age A23 
a31 432 A33 a31 Age A33 
(7) 
a11 Qy dı 
a21 Azo dy 
x= | 451 a39 ds 
a11 13 i3 
Q21 A23 A23 
a31 Age Asg 
Example 1. Solve the system of equations 
xit 2x9 =5 
3x + x3=9 
X2 + 2x3 =8 


by the matrix method. 
Solution. Let us find the determinant of the matrix of the system: 


120 
A(A)=|/0 3 1 || =5 
012 


Let us determine the inverse matrix by formula (3), Sec. 8.7: 


14 2 
5 5 
2 1 
A- = 0 F =e 
1 3 
pep e 
The matrix D will be i 
5 
D=||9 
8 
We write down the solution in matrix form, via formula (2), as follows: 
4 2 


x, I= 5 1-5 -$9 +8 


5 

xa ||=||0 5-4 Jo |= 0542-9 -48 
3 
5 


l 3 
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Equating the rows of the matrices on the left and on the right, we get 
4 2 
ss i ear a aa 


%)=20-542-9-1.8=2 


x =0-5—2.945.83 


Example 2. Solve the system of equations 
xı + 2x, + %3=0 
2x,- Xa +x; = 1 
Xiv- 3x -H Xy = 2 
by the matrix method. 
Solution. Find the determinant of the matrix of the system 


121 
A(A)=|]2 1 1 |]=1 40 
131 
We find the inverse matrix 
—2 1! #1 
A-1=|—1 0 1 
5—1—3 
Then write the solution of the system in matrix form: 
x —2 1 I jjo 3 
xofj=l}—1 0 i=l 2 
x5 |i 5—1 —3|| }2 =, 
Equating the rows of the matrices on the right and on the left, we get 
x,=3, xXg=2, x3=—7 


9.10 ORTHOGONAL MAPPINGS. 
ORTHOGONAL MATRICES 


Suppose in three-dimensional space we have two rectangular 
systems of coordinates (x,, x,, x,) and (xj, x,, x3) having a common 
origin O. Let a point M have coordinates (x,, x,, x3) and (xi, x3, 
x4) in the first and second coordinate systems (the origins need not 
coincide). 

Denote by @,, e@,, e, the unit vectors on the coordinate axes in 
the first coordinate system, by ei, €}, e, the unit vectors in the 
second coordinate system. The vectors @,, @,, @, are base vectors 
in the system (x,, x,, x,), the vectors €;, @,, €, are base vectors 
in the system (xi, xj, x3). 

Then, in the first system the vector OM will be written thus: 


OM = x,e, + x,€, + x5, (1) 
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in the second system thus: 
7 OM = x;€, + x:€, + x56; (2) 

We consider a transformation of the coordinates x,, x,, x, of 
an arbitrary point M into the coordinates xi, x}, x, of that point. 
We can say that we are considering a transformation of the space 
(Xis Xa, X,) into the space (xj, x, x3). 

This transformation has the property that a line-segment of 
length / is carried into a line-segment of the same length J. 
A triangle is carried into an equal triangle and hence two vectors 
emanating from a single point with an angle p between them go 
into two vectors of the same length and with the same angle be- 
tween them. 

A transformation having this property is called an orthogonal 
transformation. 

We can say that under an orthogonal transformation, the whole 
space is displaced like a rigid solid, or we have a displacement 
and a mirror reflection. We now determine the matrix of this trans- 
formation. 

We express the unit vectors e;, @;, e, in terms of the unit vec- 
tors €i, @,, es: 

ei = Q112, +2212, + Hy Cs 
e, = Og, + Arla + A3223 (3) 
Es = Q131 + Aggy + Aggy 


Here, 
G4, = COS (@,, @}), A. =COS(€,, €z), %,=Cos(e,, @5) 
Oa, = COS (E3, €i), Qaz = COS (2p, ez), Œs = COS (es, €;) (4) 
Qs, = COS (€z, €1,), &32 = COS (E3, E3), Œg = COS (Ez, @5) 
We write the nine direction cosines in the form of a matrix: 
Fi 1 
1, Hy, As, 
Ay. Ay Ago 
Aig Ag Ags 


S= (5) 


Using the relations (4), we can also write 


e= 4,2; F 1285 + 15, 
a= 24 + a + Gen; (6) 
e; = Q311 + Ay.€y + Aggy 

It is clear that the matrix 

O11 Xie M13 
Oo Xoz Bag 
Os, Ago Ags 


S*= (7) 
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is the transpose of S. Since ei, €,, e, are mutually perpendicular 
unit vectors, their triple scalar product is equal to +1. Thus, 


Oy, Hq, Xs, 
(€:€2€5) = O12 Lee Oye |] = 1 (8) 
O13 A23 Hg 
Similarly 
Hi, Hy, Hy 
(€,€,€5) = A (S*) = || 221 Oye M5 |] = 1 (9) 
Gg, Age Ags 
We compute the product of the matrices 
Gy, Xar May Air Ziz Qis 100 
SS* = || X12 Wee Myo |] >] Zor Moe Aa |=] 0 1 OW =E (10) 
O13 A23 Ass Gg, Aaz May 001 


Indeed, if we denote by c; the elements of the matrix of the 
product, then 


Cy, = Oh, + Oh + 05, = | 
Con = Qie + Woe Hai = | (11) 
C33 = Qis + O35 + a3 = l 
Cie = Hy My F A2122 + Ag % gq = (61€) = 0 
Similarly 
cyy=ee;=0 fo ivf (i=l, 2, 3; j=1, 2, 3) (12) 
Thus 
SS*=E . (13) 
The transpose §* coincides with the inverse §-:: 
S*=S71 (14) 


A matrix satisfying the conditions (13) or (14)—that is, the in- 
verse of its transpose—is called an orthogonal matrix. Let us now 
find the formulas for transforming the coordinates (x,, Xa, x3) into the 
coordinates (xi, X3, x), and vice versa. By virtue of formulas (3) 
and (6), the right members of (1) and (2) can be expressed either 
in terms of the basis (€,, @,, @,) or in terms of the basis (ej, e,, 
e;). Hence, we can write the equation 


X€, + X€, + Xg@y = X121 + X30, + X323 (15) 


Multiplying in succession all terms of (15) by the vector e;, by 
the vector e, by the vector e; and noting that 


ee;=0 for ij 
ee;=1 for i=j 
€;€; =%;, 


(16) 
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we get 


Xr = ygXy F geo + LyoXy (17) 
Xs = Q 3X1 F ggXy F AygXy 
Multiplying the terms of (15) in succession by e@,, €,, €, we get 


. LA ’ 
X, yy hy AX F Wy gy | 


r . 
X1 = QX F Ay X + Ag Xz | 


(18) 


Xa = Oy Xt Ages F Weg Xy 
X3 = gy Vy WggXo + AygXy 


Thus, S is the matrix of orthogonal transformations (17) and S* 
is the matrix of the inverse transformation (18). 

It is thus proved that in a Cartesian coordinate system, an 
orthogonal transformation is associated with an orthogonal matrix. 
It can be proved that if the matrices of direct and inverse trans- 
formations (17) and (18) satisfy the relation (13) or (14), that is, 
are orthogonal, then the transformation is orthogonal as well. 

If we introduce the column matrices 


xi Xi 
X =|, X=|/% (19) 
Xs Xs 
then the systems (17) and (18) can be written thus: 
X' =SX (20) 
X= SX (21) 
If we introduce the transposed matrices of (19), 
X" =l x xl X= llk % xsl (22) 
then we can write 
X” = X'S, X'=X"S (23) 
9.11 THE EIGENVECTOR OF A LINEAR TRANSFORMATION 
Definition 1. Suppose we have a vector X: 
xy 
X=||*2 (1) 
Xs 
where 
XAG + 4340 


If after transforming the vector X by means of matrix A 
[see (2), Sec. 9.5] we get a vector Y 


Y=AX (2) 
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parallel to X, 
Y=aX (3) 


where 4 is a scalar, then the vector X is termed the eigenvector 
of matrix A or the eigenvector of the given linear transformation; 
the scalar A is termed the eigenvalue. 

Let us find the eigenvector 
x, 
xX, 


of the given linear transformation or of the given matrix A. For 
X to be an eigenvector of matrix A, it is necessary that (2) and 
(©) hold true. Equating the right members of these equations, 
we get 


AX =X (4) 
or 
AX =\EX 
that is, 
(A—AE) X =0 (5) 


From this equation it follows that the vector X is defined to 
within a constant. 
Equation (4) can clearly be expanded to 


Dy 1X, + a1 + AygXy = AX, | 


Ay, X, + AgeX, + Oy5X3 = Ax, (6) 
Ay, X, + AggXq + AggXy = Ay 
and (5) to 
(2,,—A) x, + aix + 5X3 = 0 
4X1 + (Ayg—A) xX + dsx = 0 (7) 
AgX, + AyqXq-+ (Gaa — À) Xs = 0 


We obtain a system of homogeneous linear equations for deter- 
mining the coordinates x,, X}, X of the vector X. For system (7) 
to have nonzero solutions, it is necessary and sufficient for the 
determinant of the system to be equal to zero: 


a, —À aiz a3 
Qa Qa — A a3 |=0 (8) 
ay, As Asg—A 
or 
A(A—AE) =0 (9) 


This is a cubic equation in 4. It is called the characteristic equa- 
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tion of the matrix A. From this equation we can find the eigen- 
values A. 

Let us consider a case where all roots of the characteristic equa- 
tion are real and distinct. We denote them by A,, As, As. 

To each eigenvalue 4 there corresponds an eigenvector whose 
coordinates are determined from the system (7) for an appropriate 
value of A. Let us denote the eigenvectors by 1,, T}, T}. It can 
be shown that these vectors are linearly independent, that is to 
say, none can be expressed in terms of the others. Hence, any 
vector can be expressed in terms of the vectors 1,, T}, t;, that is, 
they can be taken for base vectors. 

We note without proof that all roots of the characteristic equa- 
tion of a symmetric matrix are real. 


Example 1. Find the eigenvectors and the corresponding eigenvalues of the 
matrix 


11 
Isl 
Solution. Form the characteristic equation and find the eigenvalues: 
i S =0, i.e. A?—4\—5=0, A =—], M=5 
We find the eigenvector corresponding to the eigenvalue À; =—l from the 
appropriate system of equations (7): 
(1—1) x1 + xa=0 Of 2x14 x,=0 
8x,-+(3—A,) x =0 8x, 4- 4x, =0 
Solving this system, we get x;=m, x,=—2m, where m is an arbitrary num- 


ber. The eigenvector is 
tı =mi—?2mj 


For the eigenvalue Às ==5, we write the system of equations 


—4x,;+ X =0 
8x; — 2x, =0 
The eigenvector is 
t=mi+4mf 
Example 2. Find the eigenvalues and the eigenvectors of the matrix 
7—2 0 
—2 6—2 
~—2 5 
Solution. We write the characteristic equation 
7—r’ —2 0 
—2 6—A-—2 |=0,i.e., —å3 -+ 1842 — 994 + 162 = 0 
0 —2 5—A 


The roots of this equation are: 4y=3, Ag=6, Ag=9. 
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For 4,;=3 the eigenvector is determined from the system of equations 


4x; — 2x, =0 
—2x1 + 3x3 — 2x3 =0 
_ 2x3 + 2x3 =0 


Setting x; =m, we get x =2m, xą=2m. The eigenvector 
tT =mi-+ 2mj+2mk 


Similarly we find 
t= mit mj—mk 


t= — mi+mj— + mk 


9.12 THE MATRIX OF A LINEAR TRANSFORMATION 
UNDER WHICH THE BASE VECTORS ARE EIGENVECTORS 


We now define the matrix of a linear transformation when the 
basis consists of eigenvectors t,, Ta, t,. The following relations 


must hold under this transformation: 


THAT, 
T3 = AoT (1) 
T3 = ÀT; 


where ty, Tz, t; are the images of the vectors 1, T}, Ts. 
Let the transformation matrix be 
dir Aiz lis 
A’ = || Q21 A22 A23 (2) 
Qs; Azo Ass 
Let us determine the elements of this matrix. Relative to the 
basis t,, Ta, Ts, we can write 
1 


t,=1-1,+0-1,40-1, = A 


Since the vector t, goes into the vector t{=A,t, after a trans- 


formation by the matrix A’: 
T= +0 T t0 T 


we can write 
T =T =A 
Hence 
i aii Aiz dis l 
0 || = || an azz azs ||. |O (3) 


0 | ası As: ass || 0 
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or, as a system of equations 


Ay =a: l +a: 0+ ajs: 0 
0= az: 1 +03:04 aza: 0 (4) 
0 = 5-1 + as: 0-H asa 0 
From this system we find 
ai= a ,=0, ag=0 
On the basis of the relations 
Ti = ATo Ti =À,T3 
we find in similar fashion 
aiz = 0, azz = Aes asz = 0 
Qi;=0, aa =0, az= À 
Thus, the matrix of the transformation is of the form 
4,90 0 
A’ =:||0 A, 0 (5) 
0 0A, 
The linear transformation is 
Y= Ay 
Yo= Ax (6) 
Y= N3Xq 
If A, =A, =4,=A*, then the linear transformation assumes the form 
Y=, 
Yn = MX, 
Ys =X, 


This is what is called a similarity transformation with a coeffi- 
cient 4*. Under this transformation, every vector of the space is 
an eigenvector with eigenvalue A*. 


9.13 TRANSFORMING THE MATRIX OF A LINEAR TRANSFORMATION 
WHEN CHANGING THE BASIS 
Let X be an arbitrary vector 


Xi 
Xz 
Xs 


X= =X,e, + X20, + Xas (1) 


given in the basis (€,, @,, €). The vector X is transformed by 
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the matrix A into the vector Y: 


Yı 
Y =|| Ya |= Wey + Hels + Hse, (2) 
Ys\| 
Y=AX (3) 


In the space under consideration, we introduce a new basis 
(ei, 24, e3) connected with the old basis by the change-of-basis 
formulas 


e; = 51,0, +5,,€, +b3183 
e,= b€, + be, + b52€5 | (4) 
e; = 5,,€, + b232: + D3383 
Let the vector X be written as follows in the new basis: 
xi 
X' = xe +e t+ xjej =| x) (5) 
X3 


We can write the equation 
XO, +X 2€_ + XgOq = XO; +H X36, H1363 (6) 


where the expressions (4) are substituted into the right-hand side. 
Equating the coefficients of the vectors e,, €, e, on the right and 
left, we get the equations 


X= 01x, + bit +5, 4x5 

Xa = ba, Xi +B. X4 + bax (7) 

Xs = ba X1 + b33 + b59%5 

or, briefiy, 
: X = BX’ (8) 

where 

by, by, Dis 


B=|| be, Dee bas (9) 


bs, Dye bss 
This is a nonsingular matrix that has an inverse, B-1, since 
system (7) has a definite solution for xi, x4, x;. If we write the 
vector Y in the new basis ‘ 
Y’ = ye, + yes + yes 
then quite obviously the equation 


Y=BY' (10) 
35—2082 
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will hold. Substituting (8) and (10) into (3), we get 


BY' = ABX' (11) 
Multiplying both members of the equation by B-!, we obtain 
Y' = B- ABX' (12) 
Hence, the transformation matrix A’ in the new basis will be 
A'=B"'AB (13) 
Example. Suppose, using the matrix A, 
110 
A=|11 01 


011 
we transform a vector in the basis (ei, e2, @3). Determine the transformation 
matrix A’ in the basis (€1, €z, e3) if 
= e1+2e,+ es 
4 ez =2e, } ea +323 
es=e: +e: +e 
Solution. Here, matrix B is [see formulas (4) and (9)] 
121 
211 
131 


B= 


We find the inverse matrix [A (8)= 1] 

—2 1 1 

—! 0 1 
5—1-3 


B= 


and then we find 

—-I—1 2 
—!I 0 1 
4 2—4 


B-1A= 


Finally, by formula (13), we get 


- 


—I 30 
0 10 
4—22 


A'=B-1 AB= 


Let us now prove the following theorem. 

Theorem 1. The characteristic polynomial [the left member of 
(8), Sec. 9.11] remains unchanged for any choice of basis under 
a given linear transformation. 

Proof. We write two matrix equations: 


A' = BAB 
E = BEB 
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where A and A’ are matrices corresponding to different bases for 
one and the same linear transformation, B is the change-of-basis 
matrix from new coordinates to old coordinates, and E is the unit 
(identity) matrix. š 
On the basis of the last two equations we get 
A'—\E = B~ (A—\E) B 


Passing from matrices to determinants and using the rule for 

multiplication of matrices and determinants, we get 
A (A’ —AE) = A (B-! (A—AE) B) = A (B“)- A (A—AE) A (B) 
But 
A (B~?) A (B) = A (B-1B) = A (E£) = 1 
Hence 
A (A'— ME) = A(A—AE) 

On the left and on the right we have the characteristic polynomials of 

the transformation matrices, which proves the theorem. 


9.14 QUADRATIC FORMS AND THEIR TPANSFORMATION 


Definition 1. A quadratic form in several variables is a homo- 
geneous polynomial of degree two in these variables. 
A quadratic form in three variables x,, x,, x, is of the form 


F = 4,14} + aoX3 F Ogg X§ + 20, 2%, Xp + 20,3X1X3 + Wy gh pXy (1) 
where a;; are specified numbers and the coefficients 2 are taken so 


as to simplify subsequent formulas. 
Equation (1) can be written thus: 


F = x, (Qy%, + aX: + 45%) 
+ Xo (CASA + AX + 4X5) (2) 
+ Xs (A,X, + aaa% + A55%,) 


where a; (i=1, 2, 3; f=1, 2, 3) are given numbers, and 


yx = Ag, Ais =la Q3 = Age (3) 
The matrix 
Qir Aiz As 
A= Ay, Ay, Aggy (4) 
A31 A32 Q33 


is called the matrix of the quadratic form (1). The given matrix 
is symmetric. 

We will regard (x,, x,, x,) as the coordinates of a point of space 
or the coordinates of a vector in the orthogonal basis (e,, e., @,), 
where @,, €, e, are unit vectors. 


35 * 
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Let us consider a linear transformation in the basis (e,, €., €): 


o 
Xi = 41%, + Oy .X, + a13% | 


Xa = Qoy X1 T Az2X + AggXy 
X3 = Ag1Xı + 32X3 + AggXs 


(5) 


The matrix of this transformation coincides with the matrix of the 
quadratic form. 
Let us now define two vectors 


| 
X=|% (6) 

Xa 

I] i 
Ka (7) 

| x 

We write transformation (5) as 

X'=AX (8) 


Then the quadratic form (2) can be represented as a scalar pro- 
duct of these vectors 
F=X-.AX (9) 


Let ei, e,, e, be orthogonal eigenvectors of the transformation (8) 
corresponding to the eigenvalues A,, As A, It may be proved that 
if the matrix is symmetric, then there exists an orthogonal basis 
composed of the eigenvectors of matrix A. Let us carry out the 
transformation (8) in the basis (€;, €e}, €;). Then the transformation 
matrix in this basis will be diagonal (see Sec. 9.12): 


0 
2 0 (10) 
À 


It may be shown that by applying this transformation to the 
quadratic form (1), we can reduce the latter to the form 


F = 1x3 Ax? + Agx? (11) 


The directions of- the eigenvectors e€{, @3, €, are called the prin- 
cipal directions of the quadratic form. 


9.15 The Rank of a Matrix SD 


9.15 THE RANK OF A MATRIX. 
THE EXISTENCE OF SOLUTIONS 
OF A SYSTEM OF LINEAR EQUATIONS 


Definition 1. The minor of a given matrix A is the determinant 
composed of elements of the matrix left after striking out certain 
rows and columns. 


Example 1. Suppose we have a matrix 
G11 Gyo Qis Aig 
G21 Age Q23 Q24 
G31 33 A33 34 
Third-order minors of this matrix are obtained by striking out one column and 
replacing the matrix symbol || J by the sign | | of the determinant. There are 


four. Second-order minors are obtained Dy St Sring out two columns and one 
row. There are 18. First-order minors number 


Definition 2. The rank of a matrix A is the highest order of 
a nonzero minor of A. 
Example 2. It is easy to verifv that the rank of the matrix 
1—1 0 
2 C1 


1 11 
is equal to 2. 
Example 3. The rank of the matrix 


lasl 


369 
If a matrix A is square and of order n, the rank & satisfies the 
relation k<n. As pointed out above, if k=n, the matrix is 
nonsingular, if k< n, the matrix is singular. 


For instance, the matrix 


is 1. 


010 

001 

110 
is nonsingular since A(A)=1 40; the matrix in Example 2 is singular, since 
there n=3 and k=2. : 


The concept of the rank of a matrix is widely used in the 
theory of systems of linear equations. The following theorem is 
valid. 

Theorem 1. Given a system of linear equations: 


aai + AyoXe +4,3% = b, 
A,X, + Az2X2 + AgsXq = by (1) 
a31X1 + as% + AggXy = by 
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We introduce the matrix of the system: 


G1, A12 Qis 
A = || Azı Goa Qos (2) 
Ag, Asz A33 
and the augmented matrix 
Ay, a2 Qis Dy 
B= || 421 Ass Qa be (3) 
Ag, Az, Ass Ds 


The system (1) has solutions if the rank of the matrix A is 
equal to the rank of the matrix B. The system does not have any 
solutions if the rank of A is less than the rank of B. If the rank 
of A and the rank of B is 3, then the system has a unique solution. 
If the rank of the matrices A and B is equal to 2, then the 
system has an infinitude of solutions; here, two unknowns are expres- 
sed in terms of the third, which has an arbitrary value. 

If the rank of the matrices A and B is equal to 1, then the 
system has an infinitude of solutions and two unknowns have 
arbitrary values, the third being expressed in terms of these two. 

The validity of this theorem is readily established on the basis 
of an analysis (familiar in algebra) of the solutions of a system 
of equations. This theorem holds true for a system of any number 
of equations. 


9.16 DIFFERENTIATION AND INTEGRATION OF MATRICES 


Suppose we have a matrix ||a;;(t)|| where the entries (elements) 
a; (t) of the matrix are functions of a certain argument f: 


,, (t) ay, (t) -> Ay, (É) 
Gy, (É) daa (É) ... Qan (É) 


amı (t) ama (t) ~~ + amn (t) 
We can write this more compactly as 
lla (£) I| = |l a; (£) |l (i=1, 2, besa) m, j=l, 2, ...s n) (2) 
Let the elements of the matrix have derivatives 


day; (t) damn (t) 
d ? ° dt 


lla; (8) |= (1) 


Definition 1. The derivative of a matrix ||a(t)|| is a matrix, we 
denote it by 4 lla (t) ||, whose entries are derivatives of the 
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elements of the matrix ||a(¢)||; that is, 


da day. dain 
dt dt ‘* dt 
P dası da» , dazn 
gleðl=]| % # i (3) 
damı dam damn 
dt dt “°° dt 


Note that this definition of the derivative of a matrix comes 
quite naturally if to the operations of subtraction of matrices and 
multiplication by a scalar introduced in Sec. 9.4 we adjoin the 
ee of passage to a limit: 
slim „57 (lay (t+ 40 l — Ila (8) II} 

= lim pa eA |- | tim 
At +0 Ar > k 
We -can write equation (3) more compactly in the following sym- 


bolic form: 
gla@i=|a a0 (4) 


d d 
a gla I= [aoe | (5) 
In place of the differentiation symbol = É the symbol D is often 
used, and then (5) can be written ane 
D||a||=||Da|| (6) 


Definition 2. The integral of the matrix ||a(¢)|| is a matrix, 
which we denote as 


| 


Fae) || dz 


whose elements are equal rs the integrals of the elements of the 
given matrix: 


t t 
f a,,(z)dz... f a,n (Z) dz 
to 


t 
t 
fla) || dz = Ja, (z) dz... Í ay, (z) dz 5 


. o o o o ooo sooo oo 


t t 
f am (z)dz ... f Ann (2) dz 
to to 
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More compacty, 
t 


fai; (z) dz 


t 


Í la (2) ||dz= 


to 


(8) 


or 
t 


f a(2z)dz 


te 


(9) 


t 
{la (2) llaz= 


t 
The symbol i )dz is sometimes denoted by a single let- 


to 
ter, say S, and then we can write equation (9), like we did (6), 


thus: 
S|lall= || Sa || (10) 


9.17 MATRIX NOTATION FOR SYSTEMS OF DIFFERENTIAL EQUATIONS 
AND SOLUTIONS OF SYSTEMS OF DIFFERENTIAL EQUATIONS WITH 
CONSTANT COEFFICIENTS 


We consider a system of n linear differential equations with n 
unknown functions x, (£), x(t), ---, Xn (b): 


=i = QX Haia F o -o +A Xp ) 
dx 
-i T lai + Geek + eon + 4enXp (1) 
dx, l 
dr T Oma Tanta + +++ F AnnXn 
The coefficients a;; are constants. We introduce the notation 
xı (t) 
xa (t) 
ixis]; (2) 
Xa (É) 


This is the solution matrix or the vector solution of system (1). 
We then define the matrix of derivatives of the solutions: 


Iz= (3) 
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Let us write down the matrix of coefficients of the system of di- 
fferential equations: 


an Aiz LAEN Ain 
a, a, 7+ Q 
Hel=layl= fo 2 (4) 


Any ane oh toe ann 


Using the rule for matrix multiplication (see Sec. 9.4), we can 
write the system of differential equations (1) in matrix form: 


dx, 
“dt 
dx Qi Ayn +++ Gin Xi 
2 
“dt wt Gy, Ay +++ Qon . a (5) 
den Any Ana -° Ann Xn 
|| dt 


or, more compactly on the basis of the rule for differentiating 
matrices 


d 
q ll (Ð= llall lix] (6) 
This equation can also be written as 
dx ; 
a TOY (7) 


where x is also called the vector solution; æ is short for the 
matrix ||a;; |]. 
Suppose we have 


lla || =a = : (8) 


ap 
where æ; are certain scalars. 
The set of solutions of a system of differential equations will 
be sought in the form [see formula (2), Sec. 1.30] 
xl] =eF lle] (9) 


or 
x= era (10) 
Substituting (10) into (7) [or (9) into (6)], via the rule for multi- 


plication of a matrix by a scalar and the rule for differentiating 
matrices, we get 


ketta = aetta (11) 
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whence we obtain 
ka = aa 
or l 
aa—ka=0 (12) 
Recall that in the last equation, æ is the matrix (4), k is a scalar, 


and @ is the column matrix (8). The matrix in the left member 
of (12) can be written as 


(a—kE)a=0 (13) 


where E is an identity (unit) matrix of order n. In expanded form, 
equation (13) can be rewritten thus: 


Q,—k A, «+s An a, 

Gy, Agg—R... Ayn he 
|]. || =0 (14) 

Qn, An + + + Ann —k a 


Equation (12) shows that the vector œ can be transformed by the 
matrix @ into a parallel vector ka. Hence, the vector @ is an 
eigenvector of the matrix æ corresponding to the eigenvalue k 
(see Sec. 9.11). 

In scalar form, equation (12) is written as a system of algebraic 
equations [see system (3), Sec. 1.30]. The scalar k must be deter- 
mined from equation (5) of Sec. 1.30, which in matrix form can 


be written 
A(a—kE)=0 (15) 
That is, the determinant 
a,—k ay, Qin 
Ay, A —k Aen 
arene " j=0 (16) 
anı Anz : Qnn—k 


must be equal to zero. 
Let all the roots of equation (16), 
kis kas o., ka 
be distinct. For each value k; of the system (13) we define a ma- 
trix of the values of a: 
a 
a 


at) 
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(one of these values is arbitrary). Consequently, in matrix form, 
the solution of system (1) can be written,thus: 


Xi a) a2 a Cer 
Xe mM i (n) Cyehs! 
: a af, alll, . (17) 
ail) a’) al” . 
x n Cn 
where C; are arbitrary constants, or, briefly, 
Il x || = |] || |] Cet] (18) 


In scalar form, the solutions are given by formulas (6), Sec. 1.30. 


Example 1. Write down in matrix form the system and the solution of the 
system of linear differential equations 


dx, 


eet le 
Tartar 
Solution. We write the matrix- of the system 
. H22 
A=Il13 | 
In matrix form, the system of equations is written as [see equation (5)] 
dx, 
dt 22 xı 
dxa -| l al “Tes 
dt 
We now form the characteristic equation (15) and find its roots: 
2—k 2 A 
| i Beck =0, ie, k?—5k+4=0 


hence 
kı =1 , ka = 4 
a) 


We set up system (14) to determine the values af’, af? for the root k,=1: 
(2—1) af? + 2a =0 
ay” +(3—1) af =0 


Setting af9=1, we get Pad 


In similar fashion we find af? and af? which correspond to the root ka =4. 
We obtain 


aP =l, a=! 
Now we can write the solution of the system in matrix form [formula (17)] 


EHA. 


Cet 
Cyett 
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or in the usual form: 
xı =Cyet +- Cet 
y= 5 Cet +Cett 


Example 2. Write in matrix form the svstem and the solution of the system 
of differential equations 


dxi y 

dt `! 

dx 
att es 


dx, 
pati tte + 3ta 


Solution. We write down the matrix of the system: 


100 
A=|| 120 
113 
Thus, in matrix form, the system of equations is written as [see equation (5)]: 
dx, 
a 101 x) 
dx, || _ i 
at =}/1 2 0 Xo 
dxs 
a 113 X3 
Let us form the characteristic equation (16) and find its roots: 
I—k 0 0 
1 2—k 0 |=1, that is, (l—k)(2—k)(3—k)=0 
1 1 3—k 
consequently, 


k=l, k=2, ky=3 
We determine af, af, af, which correspond to the root k= 1, from the 
system of equations (14): 
al!) + af) =0 
af + aP 4 200 <9 
to find 
aP =l, aP =— 1, as? =0 
We determine af”, a{”, a{, which correspond to the root k,y=2, from the 
system 
—a\® =0 
af?) =0 
ay” + a2” + af? =0 
to find 


a =0, aP’ =], as” 


=—1 
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We determine af”, a, af”, which correspond to the root ka =3, from the system 


—2a 9 =0 , 


aP — af —0 
3 
at + ag =0 
to find 


a =0, af =0, af? =1 


Now let us write down in matrix form the solution of the system [see formula (17)]: 


xy 1 00 Cet 
xa |=| —1 10 |I-] Cet 
` | X3 0 —i 1 Cest 
or in ordinary form 
x,=Cye 
X = — Cyet +C,e?t 
xa = — Cyett + Cat 


9.18 MATRIX NOTATION FOR A LINEAR EQUATION 
OF ORDER n 


Suppose we have an nth order linear differential equation with 
constant coefficients: 


dnx dn~ly dn-%x 
Gyn Un gyact T On- gn T+ Ta (1) 


We will see later on that this way of numbering the coefficients 
is convenient. Set x= x, and 


‘ap oe 
dx, 
anes 
m (2) 
a n 
On ax, +a + vee FAX, 
Let us write down the matrix of coefficients of the system: 
0100...0 
0010...0 
larll= us (3) 


0000...1 
A,A, AzA -+ a, 
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Then, like formula (5) of Sec. 9.17, the system (2) can be written 
as follows: 


dx 
ar 0 10 0 Xi 
Sa 0 0 1...0 A 
: Saa a Gai wae J: (4) 
dtn- 
an 1 0 0 0 1 Xn-1 
dx, 
dt a, Azas An Xn 
or, briefly. P 
ar le l=le* lll (5) 


The subsequent solution is carried through as in Sec. 9.17, since 
the matrix equation (5) is a particular case of equation (6), Sec. 9.17. 


Example. Write the equation 
dx dx 
ae =P ge + 
in matrix form. 
Solution, Put x=x,. Then 
1 


= =X 


di 
dx 
-i TPt gti 


The system of equations looks like this in matrix form: 


dx, 

it ea x, 
dx, || 

dt q P Xz 


9.19 SOLVING A SYSTEM OF LINEAR DIFFERENTIAL EQUATIONS WITH 
VARIABLE COEFFICIENTS BY THE METHOD OF SUCCESSIVE 
APPROXIMATIONS USING MATRIX NOTATION 


Let it be required to find the solution of the system of linear 
differential equations with variable coefficients 


=a, (P) Xi Hara (É) Xa + +++ + Aan (É) Xp 
Gt ay (2) x1 + ass (É) X2 +. + Aan (t) Xn 


. 8 è © è © ù © © è © © © > © o o o 


fa a an, (f) x, + ana (È) Xa + + + + + Apn (P) My 


(1) 
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that satisfy the initial conditions 
= hig te Kaon ie te Ka le tS, (2) 


If, besides the matrix of coefficients of the system and the ma- 
trix of solution, we introduce the matrix of initial conditions 


Xio 
Xap 

lx l=]: (3) 
x 


then the system of equations (1) with initial conditions (2) can be 
written thus: 


Sella) N (4) 


for the initial conditions 
l*ll=[]xl| for t=, (5) 


Here, ||a(¢)|| is again the matrix of coefficients of the system. 

We will solve the problem by the method of successive appro- 
ximations. 

To get a better grasp of the material that follows let us apply 
the method of successive approximations first to a. single linear 
equation of the first order (see Sec. 4.26). 

It is required to find the solution of the single equation 


Z =a(t)x (6) 

for the initial conditions 
x=% for t=, (7) 
We will assume that a(t) is a continuous function. As was point- 
ed out in Sec. 4.26, the solution of the differential equation (6) 


for initial conditions (7) reduces to the solution of the integral 
equation 


t 
x=x,+§ a (2) x (2) dz (8) 


to 
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We will solve this equation by the method of successive appro- 
ximations: 
t 


x, =x, + | a (2) xa dz 


te 


t 
X% = o+ fa (z) x, (z) dz 
h (9) 


©. e o s o è è è è òo ‘o 


to 


eo > © è © © © © > è o ù 


To save space we introduce the operator S (the integration ope- 
rator): l 


t 
S()=9( )ae (10) 


Using this operator S, we can write the equations (9) as follows: 
X, = Xo +S (ax) 
X= Xat S (ax,) = Xo +S (a (xo + S (ax,))) 
X3 = Xo + S (a (Xo + S (a (Xo + S (axq))))) 


Xm = Xo + S (a (Xo +S (a (xo +S (a (xo + S (a. . . ))))))) 
Expanding, we get 
Xm = Xo + Sax, + Sa Sax, + Sa Sa Sax, + . . . + Sa Sa Sa. . . Sax, 
Nii 


m times 
Taking x, outside the brackets (x, constant), we obtain 


Xm = [1 + Sa + Sa Sa + ... + Sa Sa. . . Sa] x, (11) 
Seya” 


m times 


It has been proved (see Sec. 4.26) that if a(t) is a continuous 
function, then the sequence {x,} converges. The limit of this 
sequence is a convergent series: 


e 


xX=[1-+Sa+SaSa+...] x, (12) 
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Note. If a(¢)=const, then formula (12) assumes a simple form. 
Indeed, by (10) we can write 


Sa =aS] =a (t —t,) 
Sa Sa =0°S (t— t) = a 


m times 
In this case, (12) takes the form 


= a 


s=|1 +a" LET U fan tate +...]% 


or 
x= x et lf) (13) 


The method of solving the single equation (6) that we have just 
reviewed is carried over in its entirety to the solution of system (1) 
for the initial conditions (2). 

In matrix form, system (1) with initial conditions (2) can be 
written as 


£ lxi =la (H x] (14) 

for the initial conditions 
lxll=llx l] for =t, (15) 
If we use the rule of matrix multiplication and matrix integra- 


tion, the solution of system (14), given condition (15), can be 
reduced to the solution of the matrix integral equation 


x Oll=l x I+ Slee Ill x(@ laz (16) 
We find the successive approximations 
lm (I= lel + Sa) l- ll xa-1 (2) I] dz (17) 


By successive substitution of the successive approximations under 
the integral, the solution of the system comes out like this in 
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matrix form: 


IzO= Ll +) lato (il 


F j ll 2(2,) i(i xoll + f lla (2s) Il (-- +) de, Jaz, Jde; 


or 


t 
Ix (2) || =I] x0 | H lla (24) I|- Il xo ll dz, 


t 2 
+f lael SMa) eI ldzada+... (18) 


Using the integration operator S, we can write (18) as 
lx O= ME Shal+SilallShal+. -lil 09 


The operator in square brackets can be denoted by a single letter. 
We denote it by @('2,,. Then equation (19) is compactly written as 


xO = Seo wll “oll (20) 
It is interesting to note that if the coefficients of system (1) are 
constants, then, using the rule for taking a common factor of all 
entries of the matrix outside the matrix symbol,* we can write 
t—t 
S|ja l| == al 
1 — ty)? 
Salsal =“ ale 


t—t 
SllalSllalS] al =% lla]? and so on 


In the case of constant coefficients, formula (19) assumes the form 


1x = [E+ a] ERE Na 


t—t 
+S" la+. Juzel (21) 
This equation can be symbolized in compact form as 
lx (H =e- n an x, || (22) 


* Here we do not discuss the question of passage to a limit for operations 
performed on matrices. 
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Exercises on Chapter 9 


1. Find the matrix of the inverse transformation for the linear transformation 
91 = 3X, 4-2x2, Yo= 7x p+ 5x 


2. Find the matrix of the inverse transformation 


[uf 


3. Find the oo of the matrices |; AeA |. 


5—2 


Ans. | 7 3 


Y= Xi — Xz} Yo=X1 


Ans. 


4. Given the matrices 


1 23 507 
A=||2 01 and = 123 
3—i 1 —1 0 2 
Find the matrices AB and BA. 
4 419 26 3 = 
Ans. || 9 0 16 and 14—1 
13 —2 20 5—4 af 
12 3 | 
5. Given: A=||/5 7 10 | and E, a third-order unit matrix. Determine the 
43 1 
matrix A+2E. 
32 3 
Ans. ||5 9 10 
43 3 


6. Given the matrix A=|; al . Find the matrix A. 


oe: | a |l: 


7. Suppose A= | os |. Find A2+5A. 


12 20 
Ans. lao alh 
111 
8. Find the inverse of A=|| 543 
105 1 
W—4 1 
Ans ||—25 9—2 
15—5 1 
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9. Write down the solutions of the system of equations 
xı + 2x2-+ ¥3 = 10 
2x,-+ x, +x3= 20 


X,+3x,+%3 = 30 
in matrix form and find x,, X», x3. 
x, —2 1 I | 10 
Ans. |x| =| —1 0 1ļ'20]|, x1=39, x,=20, x3 =— 60. 
X3 5—1 —3 || i39 
10. Write down in matrix form the solution of the system of equations 
xı + x+ x3=3 
5x, + 4x9 -+3x3 = 11 
10x, ++ 5x,-+- xg= 11.5 
and find xı, Xo, X3- 
x, 11—4 1 3 
Ans. || x| =|| —25 9—2]}-}] tl » x1=0.5, =l, z=1.5. 
'X3 15—5 1 11.5 
11. Find the eigenvalues and the eigenvectors of the matrix 
1 2—4 
2—2—2 
—4-—2 1 


Ans. ky =6, ka= kg =— 3; t= mit + mj—mk, Tə is any vector satisfying 


the condition (t,t,)=0, and m is an arbitrary scalar. 
12. Find the eigenvectors of the matrix 


cos a sing 
sin æ cos@ | 
Ans. They do not exist. 
400 
13. Find the eigenvectors of the matrix ||0 4 0/]]. 
004 


Ans. All the vectors are eigenvectors. 
14. Solve the following system of linear differential equations by the matrix 


method: 


dx, 
“aq T =0 
dx» 

Get in=0 


Ans, x,=Cye**+Cye-*t, xp = — 2 (Cet —Cye- 24), 
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TABLE 1 hg 


x 
The values of the function ® (x) = rs (e-ta 
m, 
0 


and the reduced Laplace function Ô (x) = ® (px) 
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0. 
0. 
0. 
0. 
0. 
0. 
0. 
0. 
0. 
0. 
0. 
0. 
0 
0. 
0. 
0 
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1. 
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l. 
1. 
l. 
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l. 
1. 
l. 
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I. 
l. 
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2. 
2. 
2.1 
2. 
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1 Site 


TABLE 2 The values of the function f (x)= — e 
V 2x 

x | fe | « Cn = | F7% 
0.00 0.3989 1.35 0.1604 + 2.70 0.0104 
0.05 0.3984 1.40 0.1497 2.75 0.0091 
0.10 0.3970 1.45 0.1394 2.80 0.0079 
0.15 0.3945 1.50 0.1295 2.85 0.0069 
0.20 0.3910 1.55 0.1200 2.90 0.0060 
0.25 0.3867 1.60 0.1109 2.95 0.0051 
0.30 0.3814 1.65 0.1023 3.00 0.0044 
0.35 0.3752 1.70 0.0940 3.05 0.0038 
0.40 0.3683 1.75 0.0863 3.10 0.0033 
0.45 0.3605 1.80 0.0790 3.15 0.0028 
0.50 0.3521 1.85 0.0721 3.20 0.0024 
0.55 0.3429 1.90 0.0656 3.25 0.0020 
0.60 0.3332 1.95 0.0596 3.30 0.0017 
0.65 0.3230 2.00 0.0540 3.35 0.0015 
0.70 0.3123 2.05 0.0488 3.40 0.0012 
0.75 0.3011 2.10 0.0440 3.45 0.0010 
0.80 0.2897 2.15 0.0396 3.50 0.0009 
0.85 0.2780 2.20 0.0355 3.55 0.0007 
0.90 0.2661 2.25 0.0317 3.60 0.0006 
0.95 0.2541 2.30 0.0283 3.65 0.0005 
1.00 0.2420 2.35 0.0252 3.70 0.0004 
1.05 0.2299 2.40 0.0224 3.75 0.0004 
1.10 0.2179 2.45 0.0198 3.80 0.0003 
1.15 0.2059 2.50 0.0175 3.85 0.0002 
1.20 0.1942 2.55 0.0154 3.90 0.0002 
1.25 0.1826 2.60 0.0136 3.95 0.0002 
1.30 0.1714 2.65 0.0119 4.00 0.0001 


x 
TABLE 3 The values of the function ® (x) = Via | e 2 dz 
x 
0 

x om | = om | - | 7% 
0.00 0.0000 0.95 0.3289 1.90 0.4713 
0.01 0.0040 1.00 0.3413 2.00 0.4772 
0.05 0.0199 1.05 0.3531 2.10 0.4821 
0.10 0.0398 1.10 0.3643 2.20 0.4861 
0.15 0.0596 1.15 0.3749 2.30 0.4893 
0.20 0.0793 1.20 0.3849 2.40 0.4918 
0.25 0.0987 1.25 0.3944 2.50 0.4938 
0.30 0.1179 1.30 0.4032 2.60 0.4953 
0.35 0.1368 1.35 0.4115 2.70 0.4965 
0.40 0.1554 1.40 0.4192 2.80 0.4974 
0.45 0.1736 1.45 0.4265 2.90 0.4981 
0.50 0.1915 1.50 0.4332 3.00 0.49865 
0.55 0.2088 1.55 0.4394 3.20 0.49931 
0.60 0.2257 1.60 0.4452 3.40 0.49966 
0.65 0.2422 1.65 0.4505 3.60 0.499841 
0.70 0.2580 1.70 0.4554 3.80 0.499927 
0.75 0.2734 1.75 0.4599 4.00 0.499968 
0.80 0.2881 1.80 0.4641 4.50 0.499997 
0.85 0.3023 1.85 0.4678 5.00 0.500000 
0.90 0.3159 { 
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Abel’s theorem 283, 284 
absolutely convergent series 272, 310 
Adam’s formula 138 
addition of probabilities 449 
theorem on 449 
adjoint 533 
adjoint matrix 533 
affine mapping 524 
alternating series 269 
amplitude 100, 101 
complex 358 
analysis, harmonic 355 
analytic function of a complex variab- 
le 310 
analyzer, Fourier 356 
angular velocity 100 
approximation(s) 
first 312 
second 313 
successive, method of 312 
zeroth 312 
arithmetic mean 467 
expectation of random variable com- 
pared with 466 
augmented matrix 550 
autonomous system 119 
auxiliary equation 76, 112, 116, 423 
axes of dispersion 503 


base vector 537 
basis 539 
Bayes’s formula 457, 458 
Bayes’s rule for the probability of 
causes 458 
bending moment 58 
Bernoulli, Jakob 446 
Bernoulli equation 32-34 
Bernoulli theorem 446 
Bessel equation 303-305 
Bessel function of the first kind 306 
Bessel function of the second kind 307 
Bessel functions, system of 366 
Bessel inequality 346 
Bezikovich, Ya. S. 137 
binomial distribution 464 
binomial series 295-297 
boundary conditions 376, 377, 384, 386 
boundary-value conditions 376 
boundary-value problem 
first 383, 395 
second 395 


Bunyakovsky, V. Ya. 195, 196 
Bunyakovsky’s inequality 196 


calculus, operational 411 
cases (events) 447 ` 
favourable 447 
catenary 13 
Cauchy’s test 264, 265 
causes 
probability of 457 
theorem of 458 
central limit theorem 512 
centras moment (first, second, third) 
474 
centre 128 
of dispersion 486 
of distribution 486 
of gravity 470 
coordinates of (of a solid) 298 
of probability distribution 469, 470, 
483 


centred random variable 470 
certain events 447 ; 
characteristic equation 541, 542 
characteristic polynomial 546 
Chebyshev, P. L. 514 
theorem of 514 
circle of convergence 310 
circulation of a vector 219 
Clairaut’s equation 46-48 
closed contour 218 
closed domain 158 
coef ficient(s) 
Fourier (see Fourier coefficients) 330 
of thermal conductivity 382, 384 
of a trigonometric series 327 
cofactor 532 
Collatz, Lothar 389 
collection, discrete 358 
column matrix 523 
common logarithms 299 
compatible random events 451 
complementary events 450 
complementary random events 449 
complete group of random events 
447 
complete integral (of a differential 
equation) 16, 56 
comple orthogonal system of functions 
3 


complete sequence of functions 364 


568 


complete system of functions 365 
complex amplitude 101, 358 
complex form of Fourier series 357 
complex Fourier coefficients 357 
complex solution 101 
complex variable 
analytic function of 310 
exponential function of 310 
cosine of 311 
power series in 309, 310 
sine of 311 
condition(s) 
boundary 376, 377, 384, 386 
boundary-value 376 
initial 16, 55, 376, 377, 384, 386 
Lipschitz 314 
conditional probability 454 
conditionally convergent series 272 
continuous random variable 475, 476 
numerical characteristics of 482 
probability density functions of 475 
continuous spectrum 364 
contour, closed 218 
convergence 
circle of 310 
domain of 310 
necessary condition for 256 
radius of 285, 310 
of a series 309 
convergent series 309 
absolutely 272 
conditionally 272 
convolution 431 
convolution formula 431 
convolution theorem 429 
coordinate(s) 
of centre of gravity of a solid 298 
curvilinear 182 
correspondence, one-to-one 182 
cosine of a complex variable 311 
curl (of a vector function) 239 
curve(s) 
distribution 476 
integral 17, 56, 121 
normal 485 
normal distribution 485 
probability 476 
probability distribution 479 
resonance 104 
smooth 67 
solution 121 
curvilinear coordinates 182 


d’Alembert’s test 260 

data, statistical 507 
decomposition theorem 426 
degenerate saddle point 131 
del operator 244 


Index 


delay theorem 439, 440 
delta function 440 
density 
distribution 476 
law of uniform 480 
probability 476 
spectral 364 
surface 160 
density function 470, 476 
of normal distribution 486 
probability 476 
dependent events 454 
derivative of a matrix 550 
determinant 
functional 184 
of a matrix 520, 522 
Wronskian 70 
deviation 471 
maximum 373 
root-mean-square 343, 471 
standard (see standard deviation) 
471, 484 
diagonal matrix 523 
diameter of a subdomain 198 
die 447 
difference(s) 
first 135 
of matrices 526 
second 135 
of third order 136 
differential equation(s) 11, 14 
exact 34 
existence of solution of 313 
first-order 15-20 
higher-order 55-56 
linear 68, 69 
ordinary 14 
differentiation of matrices 550 
Dirac delta function 441 
Dirac function 441 
direction of circulation 218 
direction field 18 
Dirichlet integral 350 
Dirichlet-Neumann problem 398, 401 
Dirichlet problem 395 
discrete collection 358 
discrete random variable 460 
distribution law of 460 
discrete spectrum 358 
disjoint events 447 
dispersion 
axes of 503 
centre of 486 
ellipses of 503 
error scale of distribution 496, 497 
sheil 444 
total ellipse of 503 
unit ellipse of 503 
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distribution 476 
binomial (see binomial distribution) 
centre of 486 
Gaussian 485 
normal! (see normal distribution) 
probability (see probability distri- 
bution) 
uniform (see uniform distribution) 
distribution curve 476 
distribution density 476 
distribution function 479, 480, 481 
normal 488 
statistical 509 
distribution law of discrete random 
variable 460 
Ditkin, V. A. 411 
divergence (of a vector) 243 
divergent series 309 
domain 
closed 158 
of convergence (of a series) 274, 310 
of integration 159 
irregular three-dimensional 199 
regular 161 
regular three-dimensional 199 
regular in the x-direction 161 
regular in the y-direction 161 
dominance (see majorization) 
dominated series 275-277 
dot product 368 
double integral 159 
double root 88 


eigenfunctions 380 
eigenvalues 380, 541 
eigenvector 
of a linear transformation 540 
of a matrix 541 
element(s) 
of a matrix 522 
in a space 367, 369 
ellipse 
of dispersion 503 
total 503 
unit 503 
of inertia 193-195 
entry of a matrix 522 
envelope (of a family of curves) 39, 42 
equal matrices 523 
equally probable events 447 
equation(s) 
auxiliary 76, 112, 116, 423 
Bernoulli’s 32-34 
Bessel’s 303-305 
characteristic 541, 542 
Clairaut’s 46-48 
of continuity 395, 397 
of a compressible liquid 397 


differential 11, 14 

of elliptic type 374 

exagt differential 34 

first-order linear 24 

of forced oscillations 98 

Fourier (for heat conduction) 374 

of free oscillations 98 

Perec 374, 375, 382, 383, 
6 


of heat transfer in a plane 387 
of heat transfer in a rod 387 
higher-order differential 55-56 
homogeneous 24 
homogeneous linear 69 
of hyperbolic type 374 
integral 312 
Lagrange’s 48-50 
Laplace’s 247, 374, 394 

in cylindrical coordinates 400 
linear 29 
linear differential 68, 69 
Lyapunov-Parseval 346 
nonhomogeneous linear 68 
HONORERES second-order linear 

8 


ordinary differential 14 
of parabolic type 374 
partial differential 14 
with separated variables 20 
system of (see system of equations) 
telegraph 378 
transform 423 
with variables separable 20 
of the vibrating string 375 
wave 376 
equipotential lines 51 
error 
mean 493 
mean arithmetic 497 
of measurement 508 
probable 493 
error distribution 496, 497 
error estimation in approximate solu- 
tions 313 
escape-velocity problem 65 
Euclidean space, n-dimensional 367 
Euler’s formula 294 
Euler’s formula for a complex z 311 
Euler’s method (of approximate solu- 
tion of first-order differential equ- 
ations) 135 
Euler’s polygon 134 
event(s) 
certain 447 
complementary 450 
complementary random 449 
dependent 454 
disjoint 447 
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event(s) 
equally probable 447 
impossible 447 
independent (see independent events) 
intersection of 451 
mutually exclusive 447 
random (see random events) 
exact differential equation 34 
existence of solution of a differential 
equation 312 
existence theorem of a line integral 219 
expectation 446 
of a centred random variable 471 
of a constant 471 
mathematical 466 
of normal distribution 485 
of a random variable compared with 
arithmetic mean 467 
exponential function of a complex 
variable 310 


factor 
integrating 37-38 
stretching 520 
Faltung 431 
family 
of curves 17 
one parari er 39 
of orthogonal trajectories 51 
favourable cases 447 
Fikhtengolts, G. M. 273 
flow lines 51 
flux (of a vector field through a sur- 
face) 233 
force, restoring 97 
forced oscillations 98, 102-105 
equation of 98 
form, quadratic (see quadratic form) 
formula(s) 
Adams’ 138 
Bayes’s 457, 458 
convolution 431 
Euler’s 294 
for a complex z 311 
Green’s 225-227 
Liouville’s 71 
Ostrogradsky 241-244 
Ostrogradsky-Gauss 243 
Stokes’ 236-241 
of total probability 456 
for transformation of coordinates in 
a double integral 185 
Fourier analyzer 356 
Fourier coefficients 330, 366 
complex 357 
Fourier cosine transform 361 
Foe equation for heat conduction 


Fourier integral 358-371 
in complex form 362-371 
Fourier inverse transform 364 
Fourier method 378 
Fourier series 327-371 
in complex form 356 
expansion of functions in a (compared 
with decomposition of vectors) 
367 
Fourier sine transform 361 
Fourier transform 364 | 
free oscillations 98, 435 
equation of 98 
frequency 100 
relative (see relative frequency) 
frequency function 476 
frequency polygon 460 
frequency table 508, 509 
function(s) 
analytic (of a 
310 
Bessel, of the first kind 306 
Bessel, of the second kind 307 
Bessel, system of 366 
complete system of 365 
continued in even fashion 342 
continued in odd fashion 342 
delta 440 
density (see density function) 
Dirac 441 
Dirac delta 441 
distribution (see distribution func- 
tion) 
exponential (of a complex variable) 
310 
frequency 476 
harmonic 247, 394 
Heaviside unit 413, 442 
homogeneous 24 
Laplace 488, 492 
Laplace, reduced 494, 495 
linearly dependent 80 
linearly independent 80 
normal (of normal distribution) 492 
original 412 
orthogonal with weight x 367 
piecewise continuous 347 
piecewise monotonic 330 
probability density 476 
of a random variable 474 
reduced Laplace 494, 495 
sequence of (orthogonal) 370 
complete 364 
series of 274 
space of 369 
spectral 364 
statistical distribution 509 
unit impulse 440 


complex variable) 
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function space 

linear 367 

linear (with quadratic metric) 370 
functional determinant 184 
functional series 274 


Gauss (Ostrogradsky-Gauss formula) 
243 


Gaussian distribution 485 

general solution (of a differential equ- 
ation) 16, 17, 56 

generalized problems 449 

geometric probability 452 

geometric progression 253 

gravity, centre of 470 

Green, George 227 

Green’s formula 225-227 


Hamiltonian operator 244 
harmonic analysis 355 
harmonic function 247, 394 
harmonic oscillations 100 
harmonic series 257, 258 
harmonics 358 
heat-conduction equation 374, 375, 382, 
383, 386 
heat transfer 
equation of (in a rod) 387 
in space 384 
Heaviside unit function 413, 442 
histogram 508, 509 
homogeneous equation 24 
homogeneous function 24 
homogeneous linear equation 69 
hypotheses (see causes and probability 
of causes) 457 


identity matrix 523, 529 
identity transformation 529 
impossible events 447 
improper iterated integral 180 
inclusive “or” 449 
independent events 452 
multiplication of probabilities 452 
inequality 
Bessel’s 346 
Bunyakovsky’s 196 
Schwarz’ 196 
inertia, moment of (see moment of 
inertia) 
initial condition(s) 16, 55, 376, 377, 
384, 386 
initial phase 100 
inner product 368 
integral(s) 14 
complete 16, 56 
Dirichlet’s 350 
double 159 


Fourier 358-360 
Fourier, in complex form 363 
improper iterated 180 
iterated 461 
line 216, 219-220 
of a matrix 551 
particular 16 
Poisson’s 179, 393, 405 
probability 489 
threefold iterated 198-204 
triple (see triple integral) 
integral curves 17, 56, 121 
integral equation 312 
integral sum 158 
integral test for convergence 266-268 
integrate a differential equation 11 
integrating factor 37-38 
integration 
domain of 159 
of matrices 550 
region of 159 
sense of 217 
interior point (of a region or domain) 


intersection of events 451 
inverse Fourier transform 364 
inverse matrix 531 
inverse transformation 524 
inversion, matrix 532 
irregular domain 199 
irrotational vector field 246 
isocline 18 
isogonal trajectories 50, 53-54 
iterated integral 161 
evaluation of 165 
improper 180 
threefold 199-203 
iteration, method of 312 
Jacobi, G. G. 184 
Jacobian 184, 207 


Kuznetsov, P. I. 411 


L-transform 412 
Lagrange’s equation 48-50 
Laplace equation 247, 374, 394 
in cylindrical coordinates 400 
Laplace function 488, 492 
reduced 494, 495 
Laplace theorem 512, 515, 516 
Laplacian operator 247, 250, 354 
large numbers, law of 516 
law 
of large numbers 516 
of uniform distribution 479, 481 
Leibniz’ theorem 269, 270 
length of a vector 368 
line (see lines) 
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line integral 216, 219-220 
linear differential equation 68, 69 
linear equation 29 
linear function space 367 
with quadratic metric 370 
linear map 517 
linear transformation 517 
eigenvector of 540 
linearity property (of a transform) 415 
linearly dependent functions 80 
linearly dependent solutions 69 
linearly independent functions 80 
linearly independent solutions 69 
lines 
equipotential 51 
flow 51 
Liouville’s formula 71 
Lipschitz condition 314 
localization, principle of 352 
logarithm, natural 299 
logical product 451 
logical sum 449 
Lurie, A. I. 411 
Lyapunov, A. M. 118, 132, 512 
Lyapunov-Parseval equation 346 
Lyapunov stable (about solutions, con- 
ditions) 118 
Lyapunov theorem 512, 513 
Lyapunov’s theory of stability 117 


Maclaurin’s series 290-291 
majorization 283 
map, linear 517 
mapping(s) 
affine 524 
one-to-one 182, 524 
orthogonal 537 
mathematical expectation 466 
mathematical statistics 444 
problems of 507 
matrices (see matrix) 
matrix (matrices) 517, 522 
addition of 526 
adjoint 533 
augmented 550 
column 523 
derivative of 550 
determinant of 520, 522 


diagonal 523 
difference of 526 
differentiation of 550 


eigenvector of 541 
element of 522 
entry of 522 
equal 523 
identity 523, 529 
integral of 551 


integration of 550 
inverse 531 
minor of 549 
multiplication of by a scalar 526 
multiplication of by unit 529 
operations on 526 
orthogonal 537, 539 
product of 526, 527 
of quadratic form 547 
rank of 549 
Tow 523 
solution 552 
square 522 
sum of 526 
transforming a vector into a vector 
by 529 
transpose of 523 
transposed 523 
unit 523, 529 
matrix inversion 532 
matrix notation 517 
for a linear equation of order n 557 
for a system of linear differential 
equations with variable coefficients 


for systems of differential equations 


for systems of linear equations 534 
matrix symbol 520 
maximum deviation 343 
mean 
arithmetic (see arithmetic mean) 
statistical 511 
weighted 511 
mean arithmetic error 497 
mean error 493 
mean-value theorem 166, 201 
measurement, error of 508 
median 484 
of narmal distribution 486 
method P 
difference (for solving systems of 
equations) 142 
Euler’s 133-135 
Fourier 378 
of iteration 312 
of successive approximation 312 
of variation of arbitrary constants 
(parameters) 84 
metric (of a space) 369 
Mikusinski, Jan G. 411 
minor of a matrix 549 
mirror reflection 521 
mode 460, 484, 486 
model, urn 449 
modulus 
of precision 498 
of a vector 368 


Index 
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moment(s) 
bending 58 
central (see central moment) 
of inertia 
of area of a plane figure 191ff 
of a solid 207 
static 197 
motion 
stationary 51 
steady-state 51 
multiplication of probabilities of inde- 
pendent events 452 
mutually exclusive events 447 


natural logarithms 299 
n-dimensional Euclidean space 367 
Neumann problem 395 
nodal point 131 
nonhomogeneous linear equation 68 
nonhomogeneous second-order linear equ- 
ations 82 
norm 369 
normal curve 485 
normal distribution 485 
density function of 486 
expectation of 485 
median of 486 
in the plane 502 
normal distribution curve 485 
normal distribution function 488, 492 
normal system of equations 106 
nth partial sum of a series 253 
number(s) 
large, law of 516 
law of large 516 
wave 358, 365 
numerical series 253 


observed values 507 
one-parameter family of curves 39 
one-to-one correspondence 182 
one-to-one mapping 182, 524 
operational calculus 411 
operator 

y-operator 244 

del 244 

Hamiltonian 244 

Laplacian 247, 250, 394 
“or” (inclusive) 449 
order of a differential equation 14 
ordinary differential equation 14 
ordinary point 46 
original function 412 
original-transform tables 413 
orthogonal Legendre polynomials 367 
orthogonal mapping 537 


orthogonal matrix 537, 539 

orthogonal sequence of functions 370 

orthogonal scien of functions, comp- 
lete 36 

orthogonal trajectories 50-53 

orthogonal transformation 538 

orthogonal vectors 368 


oscillations 
forced 98, 102-105 
free 98, 435 


harmonic 100 
Ostrogradsky, M. V. 185, 227, 243- 
Ostrogradsky formula 241-244 
Ostrogradsky-Gauss formula 243 


Panov, D. Yu. 389 
parabola, safety 43 
Parseval (Lyapunov-Parseval - equation) 
346 

partial differential equations 14 
particular integral 16 
particular solution 16, 56 
Peano’s theorem 317 
period of oscillation 100 
Petrovsky, I. G. 117, 134, 319 
phase, initial 100 
phase plane 121 
piecewise continuous function 347 
piecewise monotonic function 330 
plane, phase 121 
plus-and-minus series 271 
point (s) 

degenerate saddle 131 

interior 161 

nodal 131 

ordinary 46 

saddle 124 

singular 46 

of a space 367, 369, 370 

stable focal 125, 126 

stable nodal 122, 123 . 

unstable focal 126, 127 

unstable nodal 123 
Poisson’s integral !79, 393, 405 
polygon 

Euler’s 134 

frequency 460 

of probability distribution 460 
polynomial(s) 

characteristic 546 

orthogonal Legendre 367 
potential 

of a gravitational field 241 

of a vector 230 
potential vector field 245 
power series 283 

in a complex variable 309, 310 
precision, modulus of 498 


574 


Index 


principal directions of quadratic forms 
548 


principal standard deviations 502 
principal value of an integral 363 
principle of localization 352 
probable error 493 
probabilities (see probability) 
probability(-ties) 
addition of 449 
Bayes’s rule for (of causes) 458 
calculation of 447 
of causes 457 
Bayes’s rule for 458 
classical definition of 447 
conditional 454 
geometric 452 
multiplication of (of 
events) 452 
of random event 445, 446 
of relative frequency (in repeated 
trials) 462 
theorem on addition of 449 
total 454 
formula of 456 
probability curve 476 
probability density 476 
probability density function 476 
of continuous random variable 475, 
476 
of two-dimensional random variables 
499 
probability distribution 
centre of 469, 470, 483 
curve of 479 
polygon of 460 
probability integral 489 
probability theory 444 
subject of 445, 447 
problem(s) 
Dirichlet 395 
Dirichlet-Neumann 398, 401 
escape-velocity 65 
on firing to a first hit 461 
first boundary-value 383, 395 
generalized 449 
Neumann 395 
second boundary-value 395 
of a simple pendulum 62-66 
urn-model 449 
product 
dot 368 
inner 368 
logical 451 
of matrices 526, 527 
scalar 368 
progression, geometric 253 
property, linearity (of a transform) 415 
Prudnikov, A. P. 411 


independent 


quadratic forms 547 
matrix of 547 
principal directions of 548 


radium, rate of decay of 22 
radius of convergence 285, 310 
radius vector 205 
random event(s) 445 
complementary 449 
complete group of 447 
compatible 451 
mutually exclusive 447 
probability of 445, 446 
relative frequency of 445 
random variable(s) 
centred 470 
continuous 475, 476 
discrete 460 
functions of 474 
two-dimensional 499 
probability density function of 499 
rank of a matrix 549 
rate of decay of radium 22 
ratio of a geometric progression 253 
reduced Laplace function 494, 495 
reflection, mirror 521 
region of integration 159 
regular domain 161, 199 
relative frequency 462 
probability of (in repeated trials) 462 
of random event 445 
Tesonance 105, 439 
resonance curves 104 
restoring force 97 
resultant 431 
rigidity, spring 97 
root, double 88 
simple (single) 87 
root-mean-square deviation 343, 471 
row matrix 523 
tule 
Paves (for the probability of causes) 
4 


three-sigma 496 


saddle point 124 
safety parabola 43 
Samarsky, A. A. 382 
scalar product 368 
Schwarz inequality 196 
sense of description 218 
sense of integration 217 
separated variables 21 
sequence of functions 
complete 364 
orthogonal 370 


Index 


575 


series 
absolutely convergent 272, 310 
alternating 269 
binomial 295-297 
with complex terms 308 
conditionally convergent 272 
convergence of 309 
convergent 309 
divergent 309 
dominated 275-277 
Fourier 327-371 
definition of 330 
functional 274 
of functions 274 
harmonic 257, 258 
Maclaurin’s 290-291 
numerical 253 
plus-and-minus 271 
power 283 
power (in a complex variable) 309, 310 
statistical 508, 509 
sum of 309 
Taylor’s 290, 291 
trigonometric 327 
Shell dispersion 444 
shift theorem 416 
similarity transformation 544 
simple pendulum, problem of 62-66 
simple root 87 
simple shear transformation 521 
sine of a complex variable 311 
single root 87 
singular point 46 
singular solution of differential equ- 
ation 45 
singular transformation 525 
Smirnov, V. I. 412 
smooth curve 67 
solenoidal vector field 246 
solution(s) 
complex 101 
of a differential equation 14 
general 16, 17, 56 
linearly dependent 69 
linearly independent 69 
particular 16, 56 
singular 45 
Stable 118, 122, 125 
unstable 123, 124 
vector 552, 553 
solution curves 121 
solution matrix 552 
solve (a differential equation) 18 
space 
of functions 369 
linear function 367 
with quadratic metric 370 
n-dimensional Euclidean 367 


spectral density 364 
spectral function 364 
spectrum 358 
continueus 364 
discrete 358 
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integral (for convergence) 266-268 
theorem 
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decomposition 426 
delay 439, 440 
existence (of a line integral) 219 
of existence and uniqueness of solu- 
tion of a differential equation 15 
Laplace 512, 515, 516 
Leibniz 269, 270 
Lyapunov’s 512, 513 
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